-- Logs begin at Fri 2022-01-28 00:10:03 UTC, end at Fri 2022-01-28 01:17:01 UTC. -- Jan 28 00:48:51.838533 dv-cinder-816898-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 00:48:51.847688 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 00:48:51 2022] *** Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: nodename: dv-cinder-816898-6-iscsi Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: machine: x86_64 Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: clock source: unix Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: pcre jit disabled Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: detected number of CPU cores: 4 Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: current working directory: / Jan 28 00:48:51.849071 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: detected binary path: /usr/bin/uwsgi-core Jan 28 00:48:51.849671 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: your processes number limit is 47680 Jan 28 00:48:51.849671 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: your memory page size is 4096 bytes Jan 28 00:48:51.849671 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: detected max file descriptor number: 2048 Jan 28 00:48:51.849671 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: lock engine: pthread robust mutexes Jan 28 00:48:51.849671 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: thunder lock: enabled Jan 28 00:48:51.849671 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 00:48:51.849671 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 00:48:51.895025 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: Python main interpreter initialized at 0x562c132379c0 Jan 28 00:48:51.895025 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: python threads support enabled Jan 28 00:48:51.895025 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: your server socket listen backlog is limited to 100 connections Jan 28 00:48:51.895025 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: your mercy for graceful operations on workers is 90 seconds Jan 28 00:48:51.895347 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 00:48:51.895422 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: *** Operational MODE: preforking *** Jan 28 00:48:51.895673 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: *** uWSGI is running in multiple interpreter mode *** Jan 28 00:48:51.895673 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: spawned uWSGI master process (pid: 101581) Jan 28 00:48:51.895853 dv-cinder-816898-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 00:48:51.896502 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: spawned uWSGI worker 1 (pid: 101582, cores: 1) Jan 28 00:48:51.896741 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: spawned uWSGI worker 2 (pid: 101583, cores: 1) Jan 28 00:48:51.896896 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 00:48:53.693472 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:48:53.693472 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: from cryptography.utils import int_from_bytes Jan 28 00:48:53.694141 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:48:53.694141 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: from cryptography.utils import int_from_bytes Jan 28 00:48:53.694971 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:48:53.694971 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: from cryptography.utils import int_from_bytes Jan 28 00:48:53.695450 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:48:53.695450 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: from cryptography.utils import int_from_bytes Jan 28 00:48:56.257357 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 00:48:56.257884 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 00:48:56.258224 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 00:48:56.258346 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 00:48:56.258437 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 00:48:56.258526 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 00:48:56.258615 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 00:48:56.258702 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 00:48:56.258785 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 00:48:56.258919 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 00:48:56.259117 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.259216 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.259439 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.259536 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.259768 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.259860 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.260093 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.260179 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.260430 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.260517 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.260746 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.260832 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.261070 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.261162 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.261396 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.261480 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.261728 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.261818 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.261994 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.262079 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.262315 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.262396 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.262644 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816898-6-iscsi {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.262735 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816898-6-iscsi {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.262999 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.263085 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.263312 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.263404 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.263630 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.263779 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.264298 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.264389 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.264609 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.264704 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.264939 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.265029 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.265256 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.265338 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.265758 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.265865 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.266207 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.266327 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.266518 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.266639 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.266833 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.266990 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.267204 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.267355 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.267526 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.267617 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.267843 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.267933 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.268167 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.268251 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.268484 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.268574 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.268810 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.268901 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.269127 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.269214 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.269531 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816898-6-iscsi {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.269658 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816898-6-iscsi {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.269856 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.269946 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.270173 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.270265 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.270493 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.270573 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.270926 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.271013 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.271249 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.271423 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.271568 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.271653 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.271897 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.271989 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.272241 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.272333 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.272554 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.272643 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.272888 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.272981 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.273212 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.273301 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.273539 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.273626 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.273865 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.273948 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.274176 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.274259 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.274491 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.274572 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.274805 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.274924 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.275163 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.275246 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.275473 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.275555 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.275785 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.275878 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.276042 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.276124 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.276356 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.276451 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.276685 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.276770 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.277014 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.277097 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.277343 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.277438 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.277598 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.277692 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.277855 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.277947 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.278180 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.278263 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.278505 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.278589 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.278822 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.278923 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.279162 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.279296 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.279993 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.280097 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.280309 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.280400 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.280620 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.280703 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.280933 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.281025 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.281244 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.281344 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.281558 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.281647 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.281880 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.281963 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.282202 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.282296 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.282527 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.282654 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.282841 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.282958 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.283193 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.283286 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.283595 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.283679 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.283852 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.283945 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.284168 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.284262 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.284510 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.284592 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.284834 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.284925 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.285151 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.285234 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.285474 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.285557 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.285801 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.285884 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.286116 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.286200 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.286428 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.286510 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.286742 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.286824 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.287087 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.287174 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.287428 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.287511 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.287740 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.287824 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.287998 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.288082 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.288302 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.288385 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.288613 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.288706 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.288937 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.289021 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.289249 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.289385 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.289561 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.289657 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.289873 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.289958 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.290181 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.290278 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.290490 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.290586 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.290804 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.290935 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.291149 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.291233 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.291457 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.291552 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.291770 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.291854 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.292082 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.292171 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.292394 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.292486 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.292703 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.292786 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.293012 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.293096 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.293336 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.293429 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.293660 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.293744 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.293969 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.294053 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.294282 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.294373 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.294593 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.294677 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.294921 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.295023 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.295909 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.296011 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.296230 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.296321 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.296557 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.296642 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.296918 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.297004 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.297243 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.297350 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.297577 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.297661 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.297915 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.298002 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.298238 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.298320 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.298560 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.298649 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.298928 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.299019 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.299236 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.299321 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.299558 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.299647 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.299890 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.299975 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.300216 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.300353 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.300534 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.300630 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.300849 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.300943 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.301163 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.301256 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.301478 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.301583 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.301794 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.301884 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.302104 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.302195 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.302417 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.302516 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.302730 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.302820 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.303075 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.303170 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.303404 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.303505 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.303719 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.303809 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.304038 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.304133 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.304346 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.304447 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.304671 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.304762 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:48:56.305015 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.305111 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.305350 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.305441 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.305702 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.305798 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.306020 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.306109 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.306359 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.306451 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.306696 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.306786 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.307046 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.307138 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.307369 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.307467 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.307691 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.307782 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.308024 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.308123 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.308343 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.308440 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.308659 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.308750 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.308976 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.309075 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.309303 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.309400 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.309632 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.309735 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.309967 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.310088 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.310290 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.310388 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.310632 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.310756 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.310994 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.311244 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.311338 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.311571 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.311658 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.311906 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.312001 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.312248 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.312342 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.312565 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.312650 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.312895 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.312984 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.313242 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.313333 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.313563 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.313647 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.313893 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.313990 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.314211 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.314303 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.314536 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.314618 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.314852 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.314983 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.315192 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.315277 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.315515 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.315600 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.315838 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.315929 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.316156 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.316247 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.316476 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.316569 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.316808 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.316899 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.317131 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.317227 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.317453 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.317538 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.317765 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.317850 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.318078 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.318161 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.318389 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.318472 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.318702 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.318792 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.319031 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.319130 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.319354 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.319445 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.319683 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.319767 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.319994 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.320079 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.320322 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.320420 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.320636 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.320745 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.320950 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.321035 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.321268 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.321361 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.321584 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.321668 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.321895 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.321979 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.322209 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.322372 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.322523 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.322614 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.322835 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.322940 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.323180 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.323323 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.323493 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.323577 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.323804 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.323896 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.324129 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.324220 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.324437 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.324520 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.324748 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.324843 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.325065 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.325150 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.325378 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.325461 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.325696 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.325779 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.326010 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.326101 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.326829 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.326945 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.327176 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.327283 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.327497 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.327600 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.327831 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.327929 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.328163 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.328253 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.328474 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.328573 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.328802 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.328893 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.329131 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.329230 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.329451 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.329603 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.329766 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.329859 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.330075 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.330170 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.330381 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.330464 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.330692 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.330789 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.331025 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.331131 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.331339 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.331435 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.331644 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.331734 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.331953 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.332054 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.332262 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.332352 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.332571 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.332670 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.332877 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.332976 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.333186 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.333299 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.333502 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.333590 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.333812 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.333897 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.334118 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.334216 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.334425 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.334528 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.334736 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.334825 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.335087 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.335177 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.335418 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.335510 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.335760 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.335858 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.336082 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.336173 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.336409 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.336513 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.336728 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.336819 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.337048 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.337139 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.337360 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.337460 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.337676 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.337774 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.337991 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.338082 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.338306 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.338413 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.338625 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.338715 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.338956 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.339059 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.339284 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.339417 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.339600 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.339694 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.339919 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.340008 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.340235 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.340335 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.340560 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.340646 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.340871 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.340976 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.341187 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.341275 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.341526 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.341618 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.341862 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.341979 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.342710 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.342805 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.343060 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.343148 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.343378 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.343462 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.343699 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.343788 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.344011 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.344103 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.344329 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.344429 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.344644 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.344736 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.344956 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.345056 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.345277 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.345383 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.345594 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.345692 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.345912 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.346009 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.346219 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.346318 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.346542 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.346633 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.346855 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.346988 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.347199 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.347299 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.347508 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.347608 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.347822 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.347919 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.348145 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.348245 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.348475 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.348571 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.348833 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.348927 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.349106 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.349205 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.349428 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.349518 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.349738 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.349827 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.350085 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.350180 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.350359 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.350445 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.350669 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.350761 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.351003 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.351091 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.351317 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.351408 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.351635 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.351726 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.351945 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.352035 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.352259 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.352349 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.352566 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.352656 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.352879 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.352982 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.353184 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.353270 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.353490 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.353588 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.353797 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.353886 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.354110 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.354203 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.354431 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.354529 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.354743 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.354830 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.355091 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.355189 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.355446 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.355580 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.355730 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.355836 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.356035 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.356121 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.356358 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.356453 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.356671 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.356756 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.356979 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.357063 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.357286 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.357378 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.357590 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.357678 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.357934 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.358026 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.358247 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.358332 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.358553 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.358637 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.358871 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.358985 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.359213 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.359363 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.359524 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.359616 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.359838 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.359922 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.360150 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.360283 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.360463 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.360555 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.360780 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.360876 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.361095 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.361189 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.361405 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.361490 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.361716 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.361810 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.362030 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.362123 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.362342 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.362426 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.362654 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.362747 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.362995 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.363083 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.363306 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.363401 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.363618 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.363712 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.363931 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.364017 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.364236 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.364327 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.364546 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.364636 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.364861 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.364943 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.365249 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.365436 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.365751 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.365837 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.366075 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.366165 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.366396 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.366481 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.366719 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.366804 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.367065 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.367163 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.367398 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.367483 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.367727 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.367812 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.368042 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.368126 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.368351 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.368444 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.368665 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.368750 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.368975 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.369058 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.369283 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.369379 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.369599 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.369681 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.369905 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.369987 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.370212 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.370345 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.370517 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.370601 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.370830 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.370928 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.371162 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.371296 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.371492 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.371581 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.371805 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.371897 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.372114 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.372199 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.372431 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.372527 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.372738 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.372830 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.373054 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.373161 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.373401 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.373498 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.373718 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.373804 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.374053 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.374140 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.374369 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.374460 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.374676 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.374760 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.375009 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.375098 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.375329 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.375435 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.375662 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.375763 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.375987 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.376078 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.376322 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.376412 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.376665 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.376754 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.376971 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.377069 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.377283 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.377369 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.377610 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.377731 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.377925 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.378019 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.378230 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.378321 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.378537 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.378628 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.378846 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.378990 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.379176 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.379277 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.379470 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.379552 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.379791 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.379896 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.380105 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.380198 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.380448 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.380544 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.380726 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.380822 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.381033 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.381125 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.381344 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.381441 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.381648 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.381747 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.381962 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.382052 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.382272 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.382362 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.382578 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.382669 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.382924 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.383018 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.383216 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.383308 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.383529 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.383625 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.383839 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.383945 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.384147 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.384237 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.384453 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.384548 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.384764 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.384849 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.385069 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.385153 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.385380 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.385524 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.385687 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.385773 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.385996 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.386087 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.386306 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.386389 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.386611 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.386695 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.386943 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.387043 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.387279 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.387363 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.387584 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.387674 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.387891 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.387984 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.388203 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.388297 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.388511 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.388596 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.389329 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.389433 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.389642 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.389728 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.389961 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.390043 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.390278 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.390368 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.390584 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.390670 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.390913 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.391000 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.391225 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.391310 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.391534 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.391639 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.391838 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.391930 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.392149 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.392233 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.392449 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.392532 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.392753 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.392837 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.393058 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.393143 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.393362 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.393453 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.393669 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.393762 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.393977 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.394062 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.394295 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.394378 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.394604 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.394697 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.394929 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.395018 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.395240 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.395334 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.395552 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.395644 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.395882 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.395965 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.396213 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.396296 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.396538 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.396629 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.396856 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.396941 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.397178 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.397263 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.397494 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.397586 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.397809 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.397893 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.398123 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.398206 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.398431 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.398517 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.398743 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.398832 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.399079 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.399165 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.399397 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.399507 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.399704 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.399789 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.400011 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.400108 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.400321 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.400412 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.400634 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.400719 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.400949 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.401041 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.401274 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.401366 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.401601 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.401700 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.401926 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.402020 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.402236 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.402372 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.402548 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.402704 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.402862 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.403116 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.403212 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.403443 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.403527 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.403791 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.403877 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.404106 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.404192 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.404421 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.404511 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.404767 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.404854 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.405081 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.405194 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.405400 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.405532 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.405711 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.405858 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.406026 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.406189 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.406339 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.406511 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.406647 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.406834 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.406998 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.407181 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.407314 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.407496 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.407622 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.407834 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.407944 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.408156 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.408241 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.408473 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.408557 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.408794 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.408879 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.409112 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.409238 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.409435 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.409555 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.409752 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.409869 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.410179 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.410263 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.410495 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.410589 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.410811 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.410914 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.411157 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.411240 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.411473 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.411568 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.411783 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.411887 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.412109 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.412200 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.412434 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.412531 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.412750 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.412835 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.413100 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.413183 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.413409 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.413494 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.413714 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.413806 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.414027 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.414111 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.414354 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.414440 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.414662 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.414754 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.414996 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.415086 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.415310 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.415396 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.415635 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.415728 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.415943 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.416081 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.416261 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.416373 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.416596 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.416707 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.416913 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.417032 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.417244 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.417370 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.417671 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.417782 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.417984 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.418101 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.418299 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.418417 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.418620 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.418729 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.418966 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.419093 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.419296 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.419448 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.419603 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.419721 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.419920 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.420572 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.420760 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.420921 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.421085 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.421239 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.421412 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.421569 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.421727 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.421897 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.422028 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.422234 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.422352 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.422570 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.422668 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.422911 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.423010 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.423239 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.423350 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.423555 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.423662 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.423896 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.424013 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.424226 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.424323 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.424552 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.424678 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.424887 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.424974 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.425225 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.425316 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.425538 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.425624 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.425848 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.425932 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.426162 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.426254 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.426471 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.426589 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.426777 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.426930 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.427128 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.427251 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.427436 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.427575 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.427751 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.427893 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.428066 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.428212 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.428376 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.428547 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.428682 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.428862 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.428988 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.429186 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.429313 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.429509 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.429619 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.429828 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.429942 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.430142 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.430258 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.430458 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.430582 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.430792 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.430920 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.431132 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.431226 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.431489 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.431611 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.431817 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.431927 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.432129 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.432239 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.432427 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.432513 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.432734 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.432818 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.433079 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.433164 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.433386 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.433473 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.433706 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.433801 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.434022 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.434107 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.434339 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.434423 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.434653 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.434787 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.435012 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.435102 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.435344 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.435427 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.435708 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.436305 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.436544 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.436629 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.436874 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.436959 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.437184 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.437276 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.437493 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.437581 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.437807 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.437892 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.438116 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.438209 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.438423 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.438542 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.438732 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.438858 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.439070 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.439198 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.439378 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.439520 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.439685 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.439837 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.439992 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.440152 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.440319 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.440467 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.440629 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.440787 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.440955 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.441101 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.441269 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.441414 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.441579 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.441729 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.441889 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.442063 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.442212 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.442380 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.442526 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.442713 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.442832 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.443069 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.443189 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.443387 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.443510 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.443703 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.443836 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.444019 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.444183 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.447249 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.447383 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.447473 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.447554 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.447634 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.447714 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.447793 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.447880 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.447961 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448040 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448120 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448198 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448276 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448400 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448517 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448599 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448686 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448766 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448844 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448948 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.448948 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449095 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449173 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449251 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449329 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449454 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449454 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449598 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449675 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449760 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449848 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.449928 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.450006 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.450084 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.450162 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.450239 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.450330 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.452230 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.452230 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.452900 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.452984 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453065 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453134 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453200 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453265 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453336 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453403 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453478 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453545 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453610 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453681 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453747 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453821 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453889 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.453962 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454035 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454102 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454175 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454250 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454323 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454390 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454462 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454535 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454610 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454683 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454759 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.454965 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.455394 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.455495 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.455652 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.455736 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.455824 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.455904 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.456051 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.456188 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.456380 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.456505 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.456756 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.456850 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.457090 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.457206 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.457423 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.457511 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.457733 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.457818 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.458050 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.458205 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.458363 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.458450 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.458679 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.458766 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.459026 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.459119 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.459361 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.459446 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.459683 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.459779 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.459999 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.460086 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.460322 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.460413 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.460630 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.460724 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.460953 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.461151 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.461286 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.461472 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.461633 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.461811 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.461966 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.462140 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.462293 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.462468 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.462618 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.462785 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.462978 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.463133 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.463464 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.463557 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.463773 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.463870 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.464083 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.464177 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.464397 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.464484 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.464708 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.464807 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.465039 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.465186 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.465341 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.465471 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.465656 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.465786 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.465963 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.466093 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.466283 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.466420 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.466594 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.466724 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.467001 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.467174 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.467304 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.467529 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.467672 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.467849 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.467985 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.468179 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.468315 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.468507 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.468644 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.468826 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.468954 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.469135 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.469383 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.469520 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.469744 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.469872 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.470056 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.470195 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.470373 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.470511 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.470689 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.470818 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.471020 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.471161 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.471331 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.471468 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.471646 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.471775 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.471960 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.472089 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.472268 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.472408 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.472582 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.472710 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.472891 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.473028 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.473213 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.473348 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.473520 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.473647 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.473831 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.473959 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.474141 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.474270 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.474453 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.474579 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.474759 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.474974 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.475128 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.475331 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.475460 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.475585 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.475708 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.475831 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.475991 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.476121 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.476300 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.476435 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.476614 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.476755 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.476921 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.477050 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.477237 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.477364 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.477544 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.477687 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.477857 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.477993 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.478163 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.478291 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.478481 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.478615 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.478786 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.478937 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.479127 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.479265 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.479423 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.479560 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.479736 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.479872 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.480061 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.480197 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.480376 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.480506 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.480691 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.480820 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.481036 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.481165 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.481348 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.481476 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.481675 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.481918 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.482053 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.482253 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.482391 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.483120 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.483264 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.483462 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.483592 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.483798 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.483942 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.484111 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.484247 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.484423 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.484695 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.484833 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.485042 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.485170 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.485373 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.485508 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.485670 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.485812 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.485983 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.486121 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.486298 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.486554 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.486694 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.486943 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.487090 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.487218 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.487342 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.487455 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.487570 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.487677 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.487826 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.487956 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.488139 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.488269 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.488456 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.488620 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.488768 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.488910 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.489110 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.489240 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.489433 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.489564 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.489753 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.489883 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.490071 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.490409 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.490409 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.490687 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.490814 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.490967 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.491107 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.491243 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.491370 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.491506 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.491632 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.491755 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.491913 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.492051 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.492247 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.492379 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.492565 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.492693 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.492872 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.493010 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.493255 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.493383 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.493575 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.493705 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.493901 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.494030 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.494225 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.494366 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.494539 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.494668 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.494864 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.495015 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.495208 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.495338 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.495554 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.495776 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.495916 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.496146 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.496276 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.496476 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.496613 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.496819 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.496957 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.497152 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.497281 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.497479 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.497617 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.497819 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.497955 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.498099 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.498263 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.498431 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.498625 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.498768 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.499030 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.499163 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.499376 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.499506 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.499728 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.499857 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.500053 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.500182 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.500369 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.500498 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.500692 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.500829 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.501000 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.501127 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.501315 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.501442 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.501636 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.501766 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.501952 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.502082 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.502265 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.502402 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.502600 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.502729 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.502943 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.503076 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.503263 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.503403 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.503578 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.503707 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.503892 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.504039 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.504209 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.504353 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.504504 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.504641 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.504833 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.504963 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.505157 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.505361 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.505502 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.505649 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.505842 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.505972 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.506107 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.506233 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.506396 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.506526 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.506715 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.506844 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.507054 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.507179 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.507417 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.507560 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.507694 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.507818 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.507991 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.508123 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.508306 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.508435 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.508619 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.508757 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.508938 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.509068 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.509256 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.509386 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.509584 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.509722 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.509903 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.510030 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.510229 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.510357 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.510552 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.510688 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.510899 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.511046 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.511225 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.511352 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.511546 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.511675 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.511875 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.512003 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.512192 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.512327 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.512508 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.512637 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.512814 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.512943 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.513066 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 00:48:56.513191 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.513492 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.514394 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.514718 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.515098 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.515441 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.515769 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.516094 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.516410 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:48:56.516667 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 00:48:56.537072 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG oslo_db.sqlalchemy.engines [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:48:56.539553 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_db.sqlalchemy.engines [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:48:56.601603 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.context [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b926b697-60d5-4462-a136-42dafa155e01(cell1) {{(pid=101582) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 00:48:56.603601 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.context [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b926b697-60d5-4462-a136-42dafa155e01(cell1) {{(pid=101583) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 00:48:56.605856 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG oslo_concurrency.lockutils [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:48:56.607443 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG oslo_concurrency.lockutils [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:48:56.607829 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:48:56.608304 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG oslo_concurrency.lockutils [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:48:56.609410 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:48:56.610227 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG oslo_concurrency.lockutils [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:48:56.610315 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:48:56.612203 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:48:56.622698 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG oslo_db.sqlalchemy.engines [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:48:56.623968 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG oslo_db.sqlalchemy.engines [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:48:56.626618 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_db.sqlalchemy.engines [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:48:56.629402 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_db.sqlalchemy.engines [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:48:56.788992 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG oslo_db.sqlalchemy.engines [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:48:56.791785 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_db.sqlalchemy.engines [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:48:57.136769 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: WARNING keystonemiddleware.auth_token [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:48:57.137483 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: WARNING keystonemiddleware.auth_token [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:48:57.144333 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: WARNING keystonemiddleware.auth_token [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:48:57.144540 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: WARNING keystonemiddleware.auth_token [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:48:57.508115 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: WARNING keystonemiddleware.auth_token [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:48:57.513474 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: WARNING keystonemiddleware.auth_token [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:48:57.519120 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c132379c0 pid: 101582 (default app) Jan 28 00:48:57.521185 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:48:57.522363 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Jan 28 00:48:57.522791 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Fri Jan 28 00:48:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:48:57.537811 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: WARNING keystonemiddleware.auth_token [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:48:57.543188 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: WARNING keystonemiddleware.auth_token [None req-7974db62-fd45-43bd-8b5a-ef15a279c25e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:48:57.549426 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562c132379c0 pid: 101583 (default app) Jan 28 00:50:26.270794 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:26.271831 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jan 28 00:50:26.272425 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:26.700253 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-961d1e16-ffed-4724-aafd-4e8601c4395b admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:26.729428 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-961d1e16-ffed-4724-aafd-4e8601c4395b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.449853 Jan 28 00:50:26.730286 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1291 bytes} [Fri Jan 28 00:50:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:50:29.047348 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:29.048373 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-ed568694-a95a-414b-a9e4-0c8e9cf9ae45 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jan 28 00:50:29.048768 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:29.114319 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-e7c28c9c-2001-4a78-ace5-4ebb6b2fe58d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:29.133704 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:50:29.133704 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: warnings.warn(msg) Jan 28 00:50:29.163648 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-e7c28c9c-2001-4a78-ace5-4ebb6b2fe58d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108747 Jan 28 00:50:29.164354 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:50:29.387015 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-4221cd91-2a80-4420-9bfd-c81134618906 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:29.389744 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:50:29.389744 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: warnings.warn(msg) Jan 28 00:50:29.445509 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-4221cd91-2a80-4420-9bfd-c81134618906 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.272692 Jan 28 00:50:29.451084 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jan 28 00:50:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:50:31.751224 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-e7c28c9c-2001-4a78-ace5-4ebb6b2fe58d admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:31.752311 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-e7c28c9c-2001-4a78-ace5-4ebb6b2fe58d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jan 28 00:50:31.752727 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:31.867591 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-01853089-9744-4d4e-b68e-cd893bda83cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "ram": 512, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:31.888448 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:50:31.888448 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: warnings.warn(msg) Jan 28 00:50:31.909976 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-01853089-9744-4d4e-b68e-cd893bda83cb admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151273 Jan 28 00:50:31.911141 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:50:31.922858 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-335a90bb-5758-4191-8162-477a650503a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:31.924722 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:50:31.924722 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: warnings.warn(msg) Jan 28 00:50:31.956914 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-335a90bb-5758-4191-8162-477a650503a0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037570 Jan 28 00:50:31.957428 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jan 28 00:50:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:50:34.400382 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-01853089-9744-4d4e-b68e-cd893bda83cb admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:34.401403 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-01853089-9744-4d4e-b68e-cd893bda83cb admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jan 28 00:50:34.402183 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:34.469886 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-c3099465-506a-4cd7-8800-286511095d79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:34.490984 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-c3099465-506a-4cd7-8800-286511095d79 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082805 Jan 28 00:50:34.491822 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:50:34.503659 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-531d779b-dad7-486f-8e65-96ecd0e6fc11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:34.537186 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-531d779b-dad7-486f-8e65-96ecd0e6fc11 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037118 Jan 28 00:50:34.538113 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jan 28 00:50:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:50:36.923381 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-c3099465-506a-4cd7-8800-286511095d79 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:36.923851 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-c3099465-506a-4cd7-8800-286511095d79 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jan 28 00:50:36.924267 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:36.996002 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-987b86ad-8e80-4209-b259-ebbab8dae9cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "disk": 10, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:37.017003 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-987b86ad-8e80-4209-b259-ebbab8dae9cb admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086316 Jan 28 00:50:37.017591 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:50:37.030198 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-d68320e6-3e12-481c-afe3-795cc9be32ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:37.056768 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-d68320e6-3e12-481c-afe3-795cc9be32ed admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030687 Jan 28 00:50:37.057433 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jan 28 00:50:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:50:39.468345 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-987b86ad-8e80-4209-b259-ebbab8dae9cb admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:39.469367 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-987b86ad-8e80-4209-b259-ebbab8dae9cb admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jan 28 00:50:39.469770 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:50:39.537763 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-c8471d7f-91ad-4d92-8124-fcfc0d4bffd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "swap": 0, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:39.557094 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-c8471d7f-91ad-4d92-8124-fcfc0d4bffd7 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081170 Jan 28 00:50:39.557809 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:50:39.570281 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-d920a775-54e5-4174-9dc4-d35af6ca885d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:39.593781 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-d920a775-54e5-4174-9dc4-d35af6ca885d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027242 Jan 28 00:50:39.594482 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1335 bytes} [Fri Jan 28 00:50:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:50:41.932808 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-c8471d7f-91ad-4d92-8124-fcfc0d4bffd7 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:41.934436 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-c8471d7f-91ad-4d92-8124-fcfc0d4bffd7 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Jan 28 00:50:41.935181 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:41.999873 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-3b7c286c-3965-4083-9935-18e481a79169 admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:42.023931 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-3b7c286c-3965-4083-9935-18e481a79169 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082497 Jan 28 00:50:42.024495 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1291 bytes} [Fri Jan 28 00:50:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:50:44.512062 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-c8471d7f-91ad-4d92-8124-fcfc0d4bffd7 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:44.513139 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-c8471d7f-91ad-4d92-8124-fcfc0d4bffd7 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 Jan 28 00:50:44.513566 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:44.574594 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-515afe25-1aef-4de3-86a2-c4004662fe5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "disk": 1, "vcpus": 1, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:44.593742 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-515afe25-1aef-4de3-86a2-c4004662fe5f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073626 Jan 28 00:50:44.594305 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:50:44.608380 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-52784e1c-ced8-4b53-b481-c32859876517 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:44.632822 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-52784e1c-ced8-4b53-b481-c32859876517 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028774 Jan 28 00:50:44.634946 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jan 28 00:50:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:50:47.437550 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-515afe25-1aef-4de3-86a2-c4004662fe5f admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:47.438623 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-515afe25-1aef-4de3-86a2-c4004662fe5f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jan 28 00:50:47.439099 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:47.499487 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-267930ab-ca26-44a9-9fb1-17e9be46eab8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:47.518072 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-267930ab-ca26-44a9-9fb1-17e9be46eab8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072780 Jan 28 00:50:47.518643 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:50:47.531689 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-0b2daaab-fc3a-4eeb-9fde-678b05fad34d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:47.554937 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-0b2daaab-fc3a-4eeb-9fde-678b05fad34d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026982 Jan 28 00:50:47.555582 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jan 28 00:50:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:50:49.916900 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-267930ab-ca26-44a9-9fb1-17e9be46eab8 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:49.917916 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-267930ab-ca26-44a9-9fb1-17e9be46eab8 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jan 28 00:50:49.918480 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:49.976173 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-43b8bfe7-2d1f-45a9-ba40-247276922309 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:49.995508 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-43b8bfe7-2d1f-45a9-ba40-247276922309 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071457 Jan 28 00:50:49.996077 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:50:50.007473 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-385b7a14-b697-48bb-858f-8e551f0b38f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:50.031347 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-385b7a14-b697-48bb-858f-8e551f0b38f5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027321 Jan 28 00:50:50.032144 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jan 28 00:50:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:50:52.294016 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-43b8bfe7-2d1f-45a9-ba40-247276922309 admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:52.295732 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-43b8bfe7-2d1f-45a9-ba40-247276922309 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Jan 28 00:50:52.296316 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:52.361913 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-93684bb3-743b-4856-b063-610e9c8a3454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:52.403882 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-93684bb3-743b-4856-b063-610e9c8a3454 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.101434 Jan 28 00:50:52.414261 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:50:52.428209 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-984cd20e-8ef8-4593-ba70-f38f9dad16c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:52.458478 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-984cd20e-8ef8-4593-ba70-f38f9dad16c7 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041535 Jan 28 00:50:52.459305 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jan 28 00:50:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:50:54.731989 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-93684bb3-743b-4856-b063-610e9c8a3454 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:50:54.740173 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-93684bb3-743b-4856-b063-610e9c8a3454 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Jan 28 00:50:54.740997 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:50:54 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:50:54.806339 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-e053c371-2b8f-4af7-8d55-565636f9e76e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "ram": 16384, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:54.826076 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-e053c371-2b8f-4af7-8d55-565636f9e76e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078473 Jan 28 00:50:54.827057 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1282 bytes} [Fri Jan 28 00:50:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:50:54.838364 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-f868e4af-c6c0-4760-9167-56dca38f66d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:50:54.864720 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-f868e4af-c6c0-4760-9167-56dca38f66d9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029934 Jan 28 00:50:54.865638 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1332 bytes} [Fri Jan 28 00:50:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:51:16.465793 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-e053c371-2b8f-4af7-8d55-565636f9e76e admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:16.466848 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-e053c371-2b8f-4af7-8d55-565636f9e76e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jan 28 00:51:16.467308 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:16.524921 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-1a982844-2c35-4f18-b577-d9096d362a45 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:16.541477 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-1a982844-2c35-4f18-b577-d9096d362a45 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068173 Jan 28 00:51:16.542513 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1291 bytes} [Fri Jan 28 00:51:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:51:17.912814 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-e053c371-2b8f-4af7-8d55-565636f9e76e admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:17.913822 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-e053c371-2b8f-4af7-8d55-565636f9e76e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jan 28 00:51:17.914235 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:18.105932 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-c244a116-078b-4fde-a263-d3e74d78e21d admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:18.111386 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.wsgi [None req-c244a116-078b-4fde-a263-d3e74d78e21d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 00:51:18.111956 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-c244a116-078b-4fde-a263-d3e74d78e21d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:18.112756 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-c244a116-078b-4fde-a263-d3e74d78e21d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057654 Jan 28 00:51:18.113271 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Fri Jan 28 00:51:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 00:51:18.123072 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-c4013a35-da11-4aad-b3fd-2b6f183d4900 admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:18.143429 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-c4013a35-da11-4aad-b3fd-2b6f183d4900 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024405 Jan 28 00:51:18.143989 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jan 28 00:51:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:51:18.153991 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-a1b7aa85-73ad-41cc-9ac5-31d134869937 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:18.174850 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-a1b7aa85-73ad-41cc-9ac5-31d134869937 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024850 Jan 28 00:51:18.175537 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jan 28 00:51:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:51:18.185218 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-d57e90e3-78f5-4f1f-8aa2-d0f18efd61b5 admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:18.190554 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.wsgi [None req-d57e90e3-78f5-4f1f-8aa2-d0f18efd61b5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 00:51:18.191161 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-d57e90e3-78f5-4f1f-8aa2-d0f18efd61b5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:18.191953 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-d57e90e3-78f5-4f1f-8aa2-d0f18efd61b5 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010749 Jan 28 00:51:18.192449 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Fri Jan 28 00:51:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 00:51:19.457144 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-a1b7aa85-73ad-41cc-9ac5-31d134869937 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:19.458164 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-a1b7aa85-73ad-41cc-9ac5-31d134869937 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jan 28 00:51:19.458561 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:19.649530 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-89daa0f7-485a-4d72-9982-97b07dcf4625 admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:19.655834 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.wsgi [None req-89daa0f7-485a-4d72-9982-97b07dcf4625 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 00:51:19.656555 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-89daa0f7-485a-4d72-9982-97b07dcf4625 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:19.657188 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-89daa0f7-485a-4d72-9982-97b07dcf4625 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059531 Jan 28 00:51:19.657690 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Fri Jan 28 00:51:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 00:51:19.666965 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-0559f924-e74b-418a-a7b2-0e6470f1f8a1 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:19.680679 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-0559f924-e74b-418a-a7b2-0e6470f1f8a1 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017141 Jan 28 00:51:19.681361 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jan 28 00:51:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:51:19.690946 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-5c2fe49f-4bf6-49df-a1cc-98034a82304a admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:19.704960 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-5c2fe49f-4bf6-49df-a1cc-98034a82304a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017459 Jan 28 00:51:19.705495 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jan 28 00:51:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:51:19.714506 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-ba799cd6-a370-4d19-84d1-61fbbbd51473 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:19.720107 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.wsgi [None req-ba799cd6-a370-4d19-84d1-61fbbbd51473 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 00:51:19.720679 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-ba799cd6-a370-4d19-84d1-61fbbbd51473 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:19.721472 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-ba799cd6-a370-4d19-84d1-61fbbbd51473 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010489 Jan 28 00:51:19.721970 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Fri Jan 28 00:51:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 00:51:20.995702 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-5c2fe49f-4bf6-49df-a1cc-98034a82304a admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:20.996710 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-5c2fe49f-4bf6-49df-a1cc-98034a82304a admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jan 28 00:51:20.997116 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:51:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:21.189321 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-efc5df9d-1444-4854-b0f6-54360d1ec21a admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:21.194458 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.wsgi [None req-efc5df9d-1444-4854-b0f6-54360d1ec21a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 00:51:21.195073 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-efc5df9d-1444-4854-b0f6-54360d1ec21a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:21.195877 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-efc5df9d-1444-4854-b0f6-54360d1ec21a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057667 Jan 28 00:51:21.196391 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jan 28 00:51:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 00:51:21.206274 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-eda70a66-3646-4528-9751-2e10f660403b admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:21.219288 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-eda70a66-3646-4528-9751-2e10f660403b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016537 Jan 28 00:51:21.219827 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jan 28 00:51:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:51:21.229277 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:21.243135 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017610 Jan 28 00:51:21.243682 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Fri Jan 28 00:51:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:51:21.253433 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-a19ab933-1fb3-4fa8-852f-4d000e82960f admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:21.258673 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.wsgi [None req-a19ab933-1fb3-4fa8-852f-4d000e82960f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 00:51:21.259272 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-a19ab933-1fb3-4fa8-852f-4d000e82960f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:21.260054 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-a19ab933-1fb3-4fa8-852f-4d000e82960f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010192 Jan 28 00:51:21.260538 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jan 28 00:51:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 00:51:22.540301 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:22.541311 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 28 00:51:22.541704 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:22.732172 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-cf1f6565-c35e-48a6-8960-50380ddc72fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:22.750306 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-cf1f6565-c35e-48a6-8960-50380ddc72fb admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068425 Jan 28 00:51:22.750851 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Fri Jan 28 00:51:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:51:24.035920 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:24.036919 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jan 28 00:51:24.037324 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:51:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:24.231404 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-f2eab628-57d8-44b9-aeda-4c38cd16a936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:24.249268 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-f2eab628-57d8-44b9-aeda-4c38cd16a936 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068839 Jan 28 00:51:24.249760 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Fri Jan 28 00:51:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:51:25.518762 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:25.519793 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jan 28 00:51:25.520193 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:51:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:25.710315 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-0034f0cc-ed44-4194-a651-fc77233922db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:25.729025 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-0034f0cc-ed44-4194-a651-fc77233922db admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069871 Jan 28 00:51:25.729584 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Fri Jan 28 00:51:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:51:26.982788 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:26.983837 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 28 00:51:26.984239 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:51:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:27.174139 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-2f05e143-56ff-40ef-8a25-86fdb5d617d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:27.192035 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-2f05e143-56ff-40ef-8a25-86fdb5d617d9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068840 Jan 28 00:51:27.192515 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Fri Jan 28 00:51:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:51:28.480110 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:28.481119 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Jan 28 00:51:28.481520 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:28.673214 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-a011bc24-ee29-4940-893a-6a98a6a3c274 admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:28.692432 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-a011bc24-ee29-4940-893a-6a98a6a3c274 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069497 Jan 28 00:51:28.692901 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Fri Jan 28 00:51:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:15.857018 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:15.858037 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-63d0f665-7081-4d68-a589-67a676acadee admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jan 28 00:52:15.858456 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 930 bytes} [Fri Jan 28 00:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:52:15.918862 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-78eef295-8c1b-4c34-9644-942c24fd64a6 admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:15.939560 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-78eef295-8c1b-4c34-9644-942c24fd64a6 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074590 Jan 28 00:52:15.940132 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1291 bytes} [Fri Jan 28 00:52:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:15.963868 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-5b637844-808d-44f7-ad99-e576819676e6 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:15.972552 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-5b637844-808d-44f7-ad99-e576819676e6 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012994 Jan 28 00:52:15.973180 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1282 bytes} [Fri Jan 28 00:52:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:15.985883 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-4f3aa6e8-954b-4ea5-a5a6-02fff82ec387 admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:15.994307 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-4f3aa6e8-954b-4ea5-a5a6-02fff82ec387 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011900 Jan 28 00:52:15.994877 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1285 bytes} [Fri Jan 28 00:52:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:16.007080 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-0b6b8d8e-fcd0-4368-960b-71e1120dbb63 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:16.015417 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-0b6b8d8e-fcd0-4368-960b-71e1120dbb63 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012092 Jan 28 00:52:16.016307 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1285 bytes} [Fri Jan 28 00:52:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:16.029152 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:16.037694 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012609 Jan 28 00:52:16.038272 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1282 bytes} [Fri Jan 28 00:52:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:52.918856 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-d2193a0b-9d36-4031-a0f1-4d68f8484b7a tempest-verify_tempest_config-1181643136 tempest-verify_tempest_config-1181643136-project] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:52.920862 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-d2193a0b-9d36-4031-a0f1-4d68f8484b7a tempest-verify_tempest_config-1181643136 tempest-verify_tempest_config-1181643136-project] 10.222.0.78 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.112980 Jan 28 00:53:52.921416 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 34/69] 10.222.0.78 () {58 vars in 1133 bytes} [Fri Jan 28 00:53:52 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:55:34.827758 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:34.828854 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jan 28 00:55:34.829252 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 36/70] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:55:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:55:35.099145 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-53c31ab6-0e51-4199-8123-81be3e5182ca admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:35.100315 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:35.100315 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: warnings.warn(msg) Jan 28 00:55:35.101882 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-53c31ab6-0e51-4199-8123-81be3e5182ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.102336 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-53c31ab6-0e51-4199-8123-81be3e5182ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.103186 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-53c31ab6-0e51-4199-8123-81be3e5182ca admin admin] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.103623 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-53c31ab6-0e51-4199-8123-81be3e5182ca admin admin] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.138534 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-53c31ab6-0e51-4199-8123-81be3e5182ca admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.165193 Jan 28 00:55:35.139172 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 35/71] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jan 28 00:55:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:55:36.469940 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:36.470987 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jan 28 00:55:36.471423 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 37/72] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:55:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:36.702416 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-f1cd0c74-5a8e-4869-a445-3da122ebc7be admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:36.703827 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:36.703827 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: warnings.warn(msg) Jan 28 00:55:36.705382 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-f1cd0c74-5a8e-4869-a445-3da122ebc7be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:36.705815 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-f1cd0c74-5a8e-4869-a445-3da122ebc7be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:36.706618 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-f1cd0c74-5a8e-4869-a445-3da122ebc7be admin admin] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:36.707658 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-f1cd0c74-5a8e-4869-a445-3da122ebc7be admin admin] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:36.726557 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-f1cd0c74-5a8e-4869-a445-3da122ebc7be admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.096657 Jan 28 00:55:36.727196 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 36/73] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jan 28 00:55:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:55:48.563610 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:48.564625 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 28 00:55:48.565028 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 38/74] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:48.782455 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-5e9103ac-b206-4b5b-9833-9bdfd80a866c admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:48.783898 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:48.783898 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: warnings.warn(msg) Jan 28 00:55:48.785784 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-5e9103ac-b206-4b5b-9833-9bdfd80a866c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:48.786331 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-5e9103ac-b206-4b5b-9833-9bdfd80a866c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:48.787308 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-5e9103ac-b206-4b5b-9833-9bdfd80a866c admin admin] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:48.787843 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-5e9103ac-b206-4b5b-9833-9bdfd80a866c admin admin] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:48.813916 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-5e9103ac-b206-4b5b-9833-9bdfd80a866c admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.104580 Jan 28 00:55:48.814918 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 37/75] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jan 28 00:55:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:50.169350 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: DEBUG nova.api.openstack.wsgi [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] Calling method '>' {{(pid=101582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:50.170989 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: INFO nova.api.openstack.requestlog [None req-c989b37f-4d91-4576-9b87-7273a6b5b15d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Jan 28 00:55:50.171797 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: [pid: 101582|app: 0|req: 39/76] 10.222.0.78 () {56 vars in 1074 bytes} [Fri Jan 28 00:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:50.380143 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG nova.api.openstack.wsgi [None req-89000e19-1e8c-4524-83c1-1d4fd96f4c78 admin admin] Calling method '>' {{(pid=101583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:50.381333 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:50.381333 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: warnings.warn(msg) Jan 28 00:55:50.383007 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-89000e19-1e8c-4524-83c1-1d4fd96f4c78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:50.383515 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-89000e19-1e8c-4524-83c1-1d4fd96f4c78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:50.384535 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-89000e19-1e8c-4524-83c1-1d4fd96f4c78 admin admin] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:50.384969 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: DEBUG oslo_concurrency.lockutils [None req-89000e19-1e8c-4524-83c1-1d4fd96f4c78 admin admin] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:50.407436 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: INFO nova.api.openstack.requestlog [None req-89000e19-1e8c-4524-83c1-1d4fd96f4c78 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086348 Jan 28 00:55:50.408039 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: [pid: 101583|app: 0|req: 38/77] 10.222.0.78 () {60 vars in 1193 bytes} [Fri Jan 28 00:55:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:56:51.063563 dv-cinder-816898-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 28 00:56:51.064261 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: Fri Jan 28 00:56:51 2022 - graceful shutdown triggered... Jan 28 00:56:51.064692 dv-cinder-816898-6-iscsi devstack@n-api.service[101582]: Gracefully killing worker 1 (pid: 101582)... Jan 28 00:56:51.065295 dv-cinder-816898-6-iscsi devstack@n-api.service[101583]: Gracefully killing worker 2 (pid: 101583)... Jan 28 00:56:52.065423 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: worker 1 buried after 1 seconds Jan 28 00:56:52.066035 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: worker 2 buried after 1 seconds Jan 28 00:56:52.066035 dv-cinder-816898-6-iscsi devstack@n-api.service[101581]: goodbye to uWSGI. Jan 28 00:56:52.066999 dv-cinder-816898-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 28 00:56:52.067570 dv-cinder-816898-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 28 00:56:52.070333 dv-cinder-816898-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 00:56:52.085722 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 00:56:52 2022] *** Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: nodename: dv-cinder-816898-6-iscsi Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: machine: x86_64 Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: clock source: unix Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: pcre jit disabled Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: detected number of CPU cores: 4 Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: current working directory: / Jan 28 00:56:52.088706 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: detected binary path: /usr/bin/uwsgi-core Jan 28 00:56:52.089396 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: your processes number limit is 47680 Jan 28 00:56:52.089396 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: your memory page size is 4096 bytes Jan 28 00:56:52.089396 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: detected max file descriptor number: 2048 Jan 28 00:56:52.089396 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: lock engine: pthread robust mutexes Jan 28 00:56:52.089396 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: thunder lock: enabled Jan 28 00:56:52.089396 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 00:56:52.089396 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 00:56:52.143967 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: Python main interpreter initialized at 0x56107afd99c0 Jan 28 00:56:52.143967 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: python threads support enabled Jan 28 00:56:52.143967 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: your server socket listen backlog is limited to 100 connections Jan 28 00:56:52.143967 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: your mercy for graceful operations on workers is 90 seconds Jan 28 00:56:52.144850 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 00:56:52.144850 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: *** Operational MODE: preforking *** Jan 28 00:56:52.145160 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: *** uWSGI is running in multiple interpreter mode *** Jan 28 00:56:52.145160 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: spawned uWSGI master process (pid: 116242) Jan 28 00:56:52.145355 dv-cinder-816898-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 00:56:52.146080 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: spawned uWSGI worker 1 (pid: 116253, cores: 1) Jan 28 00:56:52.146564 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: spawned uWSGI worker 2 (pid: 116254, cores: 1) Jan 28 00:56:52.146742 dv-cinder-816898-6-iscsi devstack@n-api.service[116242]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 00:56:54.338595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:56:54.338595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: from cryptography.utils import int_from_bytes Jan 28 00:56:54.339360 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:56:54.339360 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: from cryptography.utils import int_from_bytes Jan 28 00:56:54.474700 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:56:54.474700 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: from cryptography.utils import int_from_bytes Jan 28 00:56:54.475758 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:56:54.475758 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: from cryptography.utils import int_from_bytes Jan 28 00:56:56.995523 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 00:56:56.996114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 00:56:56.996410 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 00:56:56.996663 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 00:56:56.996927 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 00:56:56.997327 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:56.997660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:56.997994 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:56.998322 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:56.998662 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:56.999009 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:56.999349 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:56.999684 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.000023 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.000290 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.000614 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.000944 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816898-6-iscsi {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.001281 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.002115 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.002434 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.002766 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.003097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.003432 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.003745 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.004256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.006160 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.006160 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.006160 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.006160 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.007555 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.007555 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.007555 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.007555 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.007555 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.009149 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.009149 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816898-6-iscsi {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.009149 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.009149 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.010394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.010394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.010394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.010394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.011859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.011859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.011859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.011859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.012979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.012979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.012979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.012979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.015347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.015347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.015347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.015347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.015939 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.015939 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.016297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.017206 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.017777 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.018350 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.018793 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.019190 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.019830 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.020124 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.020454 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.020785 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.021109 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.021485 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.021815 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.022140 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.022463 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.022785 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.023150 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.023484 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.023821 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.024225 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.024563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.025124 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.025439 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.025940 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.026310 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.026648 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.027001 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.027339 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.027674 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.027997 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.028321 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.028640 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.029017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.029308 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.029626 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.029888 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.030202 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.030520 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.030956 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.031306 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.031635 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.031956 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.032269 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.033951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.033951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.033951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.034678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.034678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.034678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.035441 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.035441 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.035912 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.035912 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.036571 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.036571 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.037026 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.037256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.037505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.037800 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.038051 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 00:56:57.038849 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.039155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 00:56:57.039403 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.039403 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.039403 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.040091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 00:56:57.040342 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.040342 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.040767 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 00:56:57.041018 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.041179 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 00:56:57.041393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.041393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.041732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.041932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.041932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.042232 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.042383 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.042540 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.042724 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.042724 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.043420 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.043624 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.043624 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.043993 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.044201 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.044441 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.044877 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.044877 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.045242 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.045462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.045462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.045736 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.045878 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.046104 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.046312 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.046312 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.046712 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.046865 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.047107 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.047284 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.047284 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.047563 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-816898-6-iscsi {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.047705 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.047851 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.047998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.047998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.048313 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.048499 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.048647 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.048788 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.048945 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.049186 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.049343 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.049486 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.049634 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.049784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.049784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.050205 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.050370 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.050370 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.050675 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.050969 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.050969 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.051391 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.051633 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.051810 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.051979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.051979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.052436 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.052680 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.052917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.053156 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.053386 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.053577 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.053811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.053985 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.054188 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.054367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.054553 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.054769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.054769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.055277 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.055488 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.055657 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.055811 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.055811 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.056095 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-816898-6-iscsi {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.056253 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.056512 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.056917 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.057157 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.057330 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.057483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.057665 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.057665 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.058029 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.058181 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.058324 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.058464 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.058611 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.058762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.059017 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.059178 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.059326 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.059326 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.059597 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.059747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.059888 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.060027 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.060166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.060314 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.060461 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.060614 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.060773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.060922 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.061064 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.061203 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.061348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.061501 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.061647 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.061787 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.061933 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.062080 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.062220 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.062369 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.062369 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.062680 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.062828 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.063050 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.063227 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.063378 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.063378 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.063717 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.064393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.064621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.064621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.065015 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.065261 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.065467 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.065663 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.065898 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.066084 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.066240 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.066390 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.066537 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.066684 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.066840 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.067145 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.067292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.067432 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.067589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.067767 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.067946 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.068095 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.068237 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.068384 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.068532 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.068673 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.068825 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.068974 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.069114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.069253 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.069408 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.069573 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.069714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.069852 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.070053 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.070210 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.070357 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.070357 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.070641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.070787 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.070964 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.070964 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.071234 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.071234 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.071532 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.071684 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.071869 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.072013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.072159 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.072308 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.072449 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.072597 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.072744 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.072891 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.073050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.073197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.073354 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.073501 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.073643 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.073792 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.073945 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.074093 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.074234 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.074380 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.074519 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.074667 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.074825 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.075008 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.075152 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.075301 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.075441 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.075586 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.075726 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.075873 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.076022 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.076161 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.076308 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.076454 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.076602 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.076756 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.076896 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.077034 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.077305 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.077459 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.077607 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.077758 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.077901 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.078040 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.078178 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.078316 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.078464 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.078650 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.078838 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.079289 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.079700 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.079962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.080215 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.080367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.080524 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.080674 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.080824 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.080965 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.081128 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.081277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.081424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.081565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.081759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.081955 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.082118 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.082267 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.082409 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.082564 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.082717 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.082865 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.083045 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.083194 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.083335 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.083487 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.083636 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.083776 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.083928 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.084121 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.084280 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.084433 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.084587 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.084728 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.084868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.085016 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.085738 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.085886 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.086047 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.086210 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.086477 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.086477 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.086773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.086773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.087088 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.087241 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.087738 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.087896 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.088045 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.088206 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.088350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.088350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.088639 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.088844 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.088991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.089141 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.089293 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.089434 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.089575 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.089722 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.089863 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.090017 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.090167 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.090317 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.090459 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.090610 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.090751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.090919 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.091078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.091078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.091354 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.091354 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.091633 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.091787 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:56:57.091936 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.092082 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.092222 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.092368 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.092538 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.092683 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.092823 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.092971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.093119 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.093259 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.093414 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.093414 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.093697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.093697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.093968 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.094109 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.094273 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.094273 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.094562 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.094744 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.094963 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.095640 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.095789 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.095929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.096076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.096224 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.096378 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.096605 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.096765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.096928 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.097069 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.097209 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.097358 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.097509 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.097659 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.097940 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.098096 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.098236 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.098376 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.098526 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.098668 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.098808 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.098991 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.099145 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.099300 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.099442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.099581 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.099720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.099869 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.100010 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.100158 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.100307 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.100448 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.100587 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.100726 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.100883 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.101035 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.101176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.101176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.101578 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.101578 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.101981 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.101981 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.102359 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.102608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.102841 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.103545 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.103729 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.103911 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.104114 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.104285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.104441 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.104597 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.104755 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.104903 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.105050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.105195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.105195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.105526 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.105726 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.106016 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.106174 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.106323 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.106469 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.106615 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.106771 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.106937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.107132 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.107302 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.107459 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.107621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.107770 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.108017 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.108303 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.108458 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.108613 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.108771 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.108919 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.109065 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.109213 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.109393 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.109548 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.109712 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.109868 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.110017 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.110017 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.110326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.110483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.110639 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.110860 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.111070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.111230 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.111230 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.111522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.111670 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.111670 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.111971 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.112127 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.112292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.112487 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.112487 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.112795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.112957 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.112957 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.113243 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.113478 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.113634 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.113788 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.113788 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.114066 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.114219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.114219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.114525 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.114671 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.114824 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.114996 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.114996 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.115288 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.115442 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.115590 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.115736 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.115889 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.116050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.116205 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.116363 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.116510 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.116664 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.116811 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.116966 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.117112 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.117265 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.117417 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.117573 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.117727 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.117883 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.118039 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.118196 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.118542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.118778 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.118992 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.119149 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.119296 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.119454 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.119616 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.119774 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.119930 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.120086 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.120240 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.120396 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.120563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.120712 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.120859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.121012 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.121159 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.121306 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.121465 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.121621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.121769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.121917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.122071 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.122229 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.122384 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.122547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.122697 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.122845 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.123103 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.123263 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.123410 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.123563 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.123709 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.123856 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.124079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.124238 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.124384 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.124538 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.124704 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.124859 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.125019 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.125175 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.125320 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.125661 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.125814 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.125970 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.127109 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.127214 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.127294 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.127375 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.127486 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.127655 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.127781 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.127781 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.127937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128097 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128249 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128345 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128445 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128445 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128709 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128791 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128865 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.128958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129121 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129204 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129204 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129204 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129204 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129473 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129545 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129614 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129698 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129780 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.129994 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.130074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.130074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.130213 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.130290 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.130426 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.130530 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.130762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.130867 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.131128 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.132661 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.132838 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.132996 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.133154 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.133297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.133434 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.133565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.133693 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.133786 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.133871 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.133945 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.134024 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.134096 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.134167 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.134245 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.134331 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.134411 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.134483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.134561 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.134672 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.135105 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.135288 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.135450 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.135752 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.136057 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.136328 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.136553 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.136799 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.137140 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.137379 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.137643 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.137904 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.138187 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.138428 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.138683 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.138962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.139194 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.139429 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.139713 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.139954 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.140195 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.140434 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.140691 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.140932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.141196 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.141409 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.141646 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.141805 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.141953 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.142204 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.142406 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.142586 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.142793 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.143069 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.143223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.143384 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.143533 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.143679 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.143827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.143981 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.143981 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.144270 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.144419 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.144829 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.144990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.145156 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.145305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.145462 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.145617 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.145764 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.145920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.146067 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.146219 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.146375 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.146522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.146676 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.146822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147023 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147148 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147245 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147694 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147781 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147874 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.147967 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148053 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148145 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148239 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148323 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148407 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148496 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148664 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148757 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148843 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.148922 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149013 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149098 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149199 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149412 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149481 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149550 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149642 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.149952 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.150056 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.150270 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.150371 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.150586 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.150689 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.151047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.151150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.151293 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.151434 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.151597 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.151693 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.151912 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.152091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.152258 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.152423 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.152582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.152731 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.152888 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.153056 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.153212 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.153376 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.153796 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.153953 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.154148 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.154357 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.154520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.154678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.154834 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.155010 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.155170 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.155338 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.155530 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.155804 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.155958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.156161 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.156309 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.156686 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.156854 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.157005 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.157321 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.157528 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.157820 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.157984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.158155 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.158449 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.158603 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.158758 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.159099 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.159297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.159463 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.159610 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.159765 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.159921 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.160067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.160223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.160384 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.160544 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.160698 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.160846 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.160991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.161146 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.161387 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.161565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.161721 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.161868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.162022 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.162186 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.162409 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.162572 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.162733 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.162919 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.163074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.163232 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.163379 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.163525 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.163709 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.163866 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.164045 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.164200 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.164346 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.164501 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.164668 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.164926 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.165087 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.165299 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.165536 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.165769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.165979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.166131 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.166277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.166552 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.166790 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.167108 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.167300 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.167474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.167660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.167845 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.168011 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.168272 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.169086 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.169264 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.169264 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.169549 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.169705 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.169705 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.169996 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.170150 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.170150 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.170450 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.170603 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.170760 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.170949 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.171107 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.171266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.171421 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.171581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.171731 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.171876 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.172031 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.172190 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.172347 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.172503 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.172658 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.172806 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.172952 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.173105 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.173767 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.173933 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.174081 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.174228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.174382 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.174529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.174695 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.174856 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.175064 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.175222 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.175377 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.175524 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.175669 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.175824 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.175972 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.176124 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.176271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.176416 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.176571 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.176892 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.177046 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.177200 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.177514 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.177669 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.177908 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.178124 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.178279 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.178545 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.178705 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.179020 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.179206 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.179364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.179525 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.179671 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.179818 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.179971 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.180205 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.180408 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.180628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.180790 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.180944 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.181102 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.181250 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.181397 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.181557 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.181712 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.181868 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.182029 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.182177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.182355 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.182512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.182689 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.182842 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.183050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.183219 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.183374 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.183608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.183773 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.183920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.184079 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.184283 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.184430 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.184576 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.184724 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.184880 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.185036 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.185189 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.185336 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.185489 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.185644 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.185818 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.185974 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.186129 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.186275 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.186428 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.186582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.186739 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.186916 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.187084 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.187233 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.187386 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.187616 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.187773 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.187773 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.188078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.188224 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.188370 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.188525 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.188673 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.188932 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.189121 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.189279 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.189433 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.189589 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.189745 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.189912 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.190060 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.190207 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.190359 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.190515 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.190945 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.191110 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.191259 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.191406 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.191553 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.191553 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.191847 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.191992 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.192150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.192303 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.192460 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.192608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.192754 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.192901 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.193056 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.193056 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.193351 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.193506 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.193667 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.193816 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.193972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.194145 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.194309 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.194458 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.194604 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.194750 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.194952 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.195108 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.195256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.195414 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.195561 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.195708 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.195864 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.196011 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.196171 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.196327 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.196483 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.196639 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.196939 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.197118 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.197278 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.197427 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.197582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.197766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.197919 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.198067 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.198067 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.198444 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.198602 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.198760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.198760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.199109 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.199301 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.199301 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.199605 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.199768 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.199916 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.200105 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.200268 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.200511 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.200674 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.200822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.201123 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.201280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.201458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.201732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.201901 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.202091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.202246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.202392 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.202547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.202711 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.202868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.203084 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.203243 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.203397 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.203546 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.203701 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.203849 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.203996 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.204151 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.204305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.204967 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.205154 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.205303 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.205459 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.205639 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.205795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.205975 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.206302 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.206464 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.206643 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.206861 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.207045 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.207210 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.207366 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.207531 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.207689 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.207905 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.208067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.208288 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.208444 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.208623 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.208778 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.208926 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.209070 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.209227 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.209383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.209541 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.209688 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.209914 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.210123 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.210287 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.210474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.210679 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.210853 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.211089 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.211240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.211476 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.211627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.211775 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.211949 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.212099 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.212269 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.212511 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.212759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.212759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.213089 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.213248 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.213406 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.213564 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.213720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.213868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.214023 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.214190 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.214352 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.214352 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.214649 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.214797 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.214976 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.215140 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.215296 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.215443 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.215598 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.215752 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.215901 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.216070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.216228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.216382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.216538 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.216693 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.216841 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.216997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.217151 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.217311 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.217458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.217604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.217750 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.217906 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.218063 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.218210 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.218364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.218512 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.218673 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.218822 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.219024 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.219173 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.219321 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.219469 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.219627 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.219783 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.219941 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.220124 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.220311 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.220461 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.220624 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.220780 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.220935 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.221091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.221246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.221402 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.221560 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.221759 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.221913 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.222060 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.222217 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.222378 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.222528 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.222673 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.222820 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.223057 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.223216 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.223405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.223544 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.223660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.223775 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.223934 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.224065 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.224330 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.224586 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.224763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.224899 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.225045 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.225179 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.225325 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.225458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.225630 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.225766 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.225952 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.226064 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.226275 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.226416 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.226701 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.226912 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.227097 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.227261 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.227412 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.227588 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.227746 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.227921 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.228076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.228255 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.228408 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.228595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.228763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.228925 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.229083 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.229314 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.229473 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.229632 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.229790 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.229946 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.230109 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.230259 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.230406 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.230552 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.230714 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.230862 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.231064 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.231217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.231365 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.231512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.231667 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.231815 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.231978 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.232134 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.232290 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.232439 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.232605 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.232764 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.232921 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.233069 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.233247 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.233409 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.233584 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.233746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.233895 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.234065 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.234226 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.234374 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.234534 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.234706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.234856 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.235046 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.235196 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.235354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.235516 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.235666 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.236351 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.236513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.236670 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.236818 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.237020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.237193 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.237350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.237500 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.237647 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.237794 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.237952 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.238108 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.238264 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.238413 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.238560 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.238707 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.238868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.239057 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.239225 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.239374 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.239521 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.239682 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.239839 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.239987 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.240134 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.240282 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.240429 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.240583 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.240732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.240886 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.241052 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.241209 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.241366 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.241526 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.241681 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.241836 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.241984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.242138 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.242299 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.242448 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.242603 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.242791 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.242979 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.243143 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.243301 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.243452 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.243599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.243746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.243893 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.244047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.244271 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.244422 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.244570 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.244725 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.244872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.245034 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.245205 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.245362 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.245519 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.245712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.245871 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.246033 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.246192 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.246347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.246503 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.247262 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.247262 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.247484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.247484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.247663 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.247663 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.247830 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.247915 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.248013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.248228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.248332 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.248547 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.248641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.248870 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.248979 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.249197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.249309 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.249743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.249856 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.249954 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.250049 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.250190 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.250292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.250532 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.250623 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.250869 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.251008 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.251227 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.251326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.252138 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.252254 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.252472 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.252565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.252803 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.252909 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.253125 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.253228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.253464 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.253554 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.253778 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.253975 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.254137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.254302 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.254453 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.254603 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.254751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.254936 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.255105 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.255255 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.255409 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.255559 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.255714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.255889 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.256055 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.256204 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.256352 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.256499 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.256658 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.256807 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.256993 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.257160 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.257317 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.257464 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.257657 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.257826 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.257993 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.258151 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.258299 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.258447 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.258594 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.258750 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.258944 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.259099 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.259331 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116254) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 00:56:57.259487 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.259683 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.260016 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.260559 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.260890 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.261240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.261584 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.261923 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.262257 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.262591 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.262959 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.263285 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.263611 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.263939 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.264263 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.264582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.264920 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.265246 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.265573 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.265909 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.266232 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.266784 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.267203 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.267537 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.267875 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.268222 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.268549 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.268867 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.269205 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.269783 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.270106 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.270438 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.270765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.271112 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.271434 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.271765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.272090 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.272411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.272738 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.273116 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.273467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.273789 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.274106 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.274429 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.274755 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.275100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.275419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.275741 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.276058 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.276387 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.276706 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.277095 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.277354 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.277678 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.277993 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.278316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.278723 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.278997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.279320 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.279638 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.279973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.280568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.280715 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.280948 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.281315 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.281843 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.282192 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.282999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.283357 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.283698 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.284055 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.284403 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.284727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.285052 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.285371 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.285717 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.285881 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_db.sqlalchemy.engines [None req-525910d7-307e-4946-a730-c14703193304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:56:57.286051 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.286362 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.286687 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.287036 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.287368 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.287687 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.288010 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.288336 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.288658 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.288982 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.289306 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.289638 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.289996 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.290338 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.290667 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.291026 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.291359 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.291685 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.292009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.292333 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.292661 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.292987 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.293325 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.293653 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.293970 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.294415 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.294741 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.295097 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.295446 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.295768 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.296107 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.296444 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.296771 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.297122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.297418 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.297762 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.298114 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.298999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.299339 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.299666 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.299982 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.300300 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.300629 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.300969 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.301315 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.301641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.301979 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.302297 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.302632 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.302975 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.303313 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.303648 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.303989 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.304311 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.304656 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.304976 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.305302 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.305636 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.305957 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.306281 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.306605 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.306967 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.307309 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.307628 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.307966 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.308295 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.308629 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.308959 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.309283 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.309627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.309951 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.310278 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.310601 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.310950 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.311279 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.311609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.311948 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.312286 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.312625 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.312964 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.313324 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.313651 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.314578 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.314926 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.315254 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.315584 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.315904 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:56:57.316158 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 00:56:57.339355 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_db.sqlalchemy.engines [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:56:57.352687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.context [None req-525910d7-307e-4946-a730-c14703193304 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b926b697-60d5-4462-a136-42dafa155e01(cell1) {{(pid=116254) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 00:56:57.357020 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-525910d7-307e-4946-a730-c14703193304 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.358613 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-525910d7-307e-4946-a730-c14703193304 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:57.359481 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-525910d7-307e-4946-a730-c14703193304 None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.361989 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-525910d7-307e-4946-a730-c14703193304 None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:57.372934 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_db.sqlalchemy.engines [None req-525910d7-307e-4946-a730-c14703193304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:56:57.374299 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_db.sqlalchemy.engines [None req-525910d7-307e-4946-a730-c14703193304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:56:57.403611 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.context [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b926b697-60d5-4462-a136-42dafa155e01(cell1) {{(pid=116253) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 00:56:57.408170 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.409849 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:57.410692 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.412681 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:57.423055 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_db.sqlalchemy.engines [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:56:57.425020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_db.sqlalchemy.engines [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:56:57.542208 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_db.sqlalchemy.engines [None req-525910d7-307e-4946-a730-c14703193304 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116254) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:56:57.592204 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_db.sqlalchemy.engines [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:56:57.898692 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: WARNING keystonemiddleware.auth_token [None req-525910d7-307e-4946-a730-c14703193304 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:56:57.905582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: WARNING keystonemiddleware.auth_token [None req-525910d7-307e-4946-a730-c14703193304 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:56:57.955968 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: WARNING keystonemiddleware.auth_token [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:56:57.963791 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: WARNING keystonemiddleware.auth_token [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:56:58.273220 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: WARNING keystonemiddleware.auth_token [None req-525910d7-307e-4946-a730-c14703193304 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:56:58.278701 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: WARNING keystonemiddleware.auth_token [None req-525910d7-307e-4946-a730-c14703193304 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:56:58.284537 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56107afd99c0 pid: 116254 (default app) Jan 28 00:56:58.332809 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: WARNING keystonemiddleware.auth_token [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:56:58.338525 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: WARNING keystonemiddleware.auth_token [None req-fc61856d-f63d-4c06-a3c8-3f3f415dd5ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:56:58.344015 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56107afd99c0 pid: 116253 (default app) Jan 28 00:57:36.976777 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f652097e-adb4-4950-8609-a5917cd69f4e tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] Action: 'create', calling method: .version_select at 0x7f1a0b211ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1868490418", "metadata": {"Type": "work"}}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:37.231342 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a69b7c55-21fa-4d6a-8442-bc9e590c3d91 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Action: 'create', calling method: .version_select at 0x7f1a0b210ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1305903085"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:38.964911 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f652097e-adb4-4950-8609-a5917cd69f4e tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.800099 Jan 28 00:57:38.967649 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1155 bytes} [Fri Jan 28 00:57:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3805 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 00:57:39.068439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a69b7c55-21fa-4d6a-8442-bc9e590c3d91 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.297091 Jan 28 00:57:39.070633 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 1/2] 10.222.0.78 () {60 vars in 1154 bytes} [Fri Jan 28 00:57:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3302 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 00:57:39.440884 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2051596676", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "networks": [{"uuid": "5449d510-4630-4ba6-b676-1c4b9d289300"}]}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:39.509807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-75a632d6-79a6-4bfa-ba7c-ffeeb474ab77 tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Action: 'create', calling method: .version_select at 0x7f1a0b17b820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1811417177", "metadata": {"Type": "work"}}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:39.513125 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-75a632d6-79a6-4bfa-ba7c-ffeeb474ab77 tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:39.513885 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-75a632d6-79a6-4bfa-ba7c-ffeeb474ab77 tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.544440 Jan 28 00:57:39.519904 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 2/3] 10.222.0.78 () {60 vars in 1155 bytes} [Fri Jan 28 00:57:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 547 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:57:39.523678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-808ca6d3-3ce2-4972-ae49-d212b818b82c tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] Calling method '.version_select at 0x7f1a0b9fb4c0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:39.589760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-808ca6d3-3ce2-4972-ae49-d212b818b82c tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121" status: 200 len: 353 microversion: 2.1 time: 0.072398 Jan 28 00:57:39.590992 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 3/4] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:39 2022] GET /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:39.597971 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-15a2dfe0-b2e0-46f9-b2f8-321652a7b520 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0b071160>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:39.663226 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] validate_networks() for [('5449d510-4630-4ba6-b676-1c4b9d289300', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:57:39.689524 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-15a2dfe0-b2e0-46f9-b2f8-321652a7b520 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c" status: 200 len: 345 microversion: 2.1 time: 0.096800 Jan 28 00:57:39.690628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 4/5] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:39 2022] GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:39.711826 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-679fcb75-df36-42dd-8561-514a7c9b208f tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Action: 'create', calling method: .version_select at 0x7f1a0b071af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-522680885", "metadata": {"Type": "work"}}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:39.713974 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-679fcb75-df36-42dd-8561-514a7c9b208f tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:39.720323 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-679fcb75-df36-42dd-8561-514a7c9b208f tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024613 Jan 28 00:57:39.727475 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 5/6] 10.222.0.78 () {60 vars in 1155 bytes} [Fri Jan 28 00:57:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:57:39.750111 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8935a36b-361c-48e7-afcb-178a922d7418 tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Action: 'create', calling method: .version_select at 0x7f1a0b071a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-963677577", "metadata": {"Type": "work"}}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:39.754599 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8935a36b-361c-48e7-afcb-178a922d7418 tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:39.759260 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8935a36b-361c-48e7-afcb-178a922d7418 tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024933 Jan 28 00:57:39.760501 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 6/7] 10.222.0.78 () {60 vars in 1155 bytes} [Fri Jan 28 00:57:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 00:57:39.792993 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d4447c1a-dd7d-4a84-a734-3d2a49bf8d9b tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Calling method '.version_select at 0x7f1a0b0713a0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:39.891618 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-d4447c1a-dd7d-4a84-a734-3d2a49bf8d9b tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] HTTP exception thrown: Volume tempest-invalid-1554005234 could not be found. Jan 28 00:57:39.892233 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d4447c1a-dd7d-4a84-a734-3d2a49bf8d9b tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Returning 404 to user: Volume tempest-invalid-1554005234 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:39.893091 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d4447c1a-dd7d-4a84-a734-3d2a49bf8d9b tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1554005234" status: 404 len: 99 microversion: 2.1 time: 0.123791 Jan 28 00:57:39.893975 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 7/8] 10.222.0.78 () {58 vars in 1217 bytes} [Fri Jan 28 00:57:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1554005234 => generated 99 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 28 00:57:39.905909 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8c5a7543-7033-4b39-8299-aabccf8f3e9f tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003577 Jan 28 00:57:39.906810 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 8/9] 10.222.0.78 () {58 vars in 1139 bytes} [Fri Jan 28 00:57:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 28 00:57:39.918094 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-85e8cbd3-6163-4176-bcce-51916e06d172 tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003620 Jan 28 00:57:39.918646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 9/10] 10.222.0.78 () {58 vars in 1136 bytes} [Fri Jan 28 00:57:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 28 00:57:39.930675 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4c2ad705-6f9c-4550-b155-88b6a7d1830e tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Calling method '.version_select at 0x7f1a0b0dfc10>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:39.994171 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-4c2ad705-6f9c-4550-b155-88b6a7d1830e tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] HTTP exception thrown: Volume 13d94656-ee26-4b32-a1f3-bbc92588b816 could not be found. Jan 28 00:57:39.995210 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4c2ad705-6f9c-4550-b155-88b6a7d1830e tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Returning 404 to user: Volume 13d94656-ee26-4b32-a1f3-bbc92588b816 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:39.995746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4c2ad705-6f9c-4550-b155-88b6a7d1830e tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/13d94656-ee26-4b32-a1f3-bbc92588b816" status: 404 len: 109 microversion: 2.1 time: 0.069497 Jan 28 00:57:39.996298 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 10/11] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jan 28 00:57:39 2022] DELETE /compute/v2.1/os-volumes/13d94656-ee26-4b32-a1f3-bbc92588b816 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:57:40.007365 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-25f4597c-9fb9-4c0a-b7d9-8149709f9b4c tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Calling method '.version_select at 0x7f1a0b071550>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:40.062525 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-25f4597c-9fb9-4c0a-b7d9-8149709f9b4c tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] HTTP exception thrown: Volume c5d26623-a88f-4d42-99fc-f7cc6bea1b7f could not be found. Jan 28 00:57:40.063235 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-25f4597c-9fb9-4c0a-b7d9-8149709f9b4c tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] Returning 404 to user: Volume c5d26623-a88f-4d42-99fc-f7cc6bea1b7f could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:40.064068 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-25f4597c-9fb9-4c0a-b7d9-8149709f9b4c tempest-VolumesNegativeTest-1027747797 tempest-VolumesNegativeTest-1027747797-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/c5d26623-a88f-4d42-99fc-f7cc6bea1b7f" status: 404 len: 109 microversion: 2.1 time: 0.060420 Jan 28 00:57:40.064622 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 11/12] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:40 2022] GET /compute/v2.1/os-volumes/c5d26623-a88f-4d42-99fc-f7cc6bea1b7f => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:57:40.607312 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-619d3a4c-c1dc-48db-ae4a-a4589df0e080 tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] Calling method '.version_select at 0x7f1a0b0dfa60>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:40.664208 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-619d3a4c-c1dc-48db-ae4a-a4589df0e080 tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121" status: 200 len: 354 microversion: 2.1 time: 0.064318 Jan 28 00:57:40.665484 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 12/13] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:40 2022] GET /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121 => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:40.681397 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f17c2a77-02f9-4b55-b6d9-a7c36d49dbfb tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] Calling method '.version_select at 0x7f1a0b071940>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:40.760757 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f17c2a77-02f9-4b55-b6d9-a7c36d49dbfb tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121" status: 200 len: 354 microversion: 2.1 time: 0.083302 Jan 28 00:57:40.772419 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 13/14] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:40 2022] GET /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:40.786795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d73e3e60-c8ad-4de3-8131-d1f2991b2df3 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0b0861f0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:40.906788 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d73e3e60-c8ad-4de3-8131-d1f2991b2df3 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c" status: 200 len: 346 microversion: 2.1 time: 0.132857 Jan 28 00:57:40.916796 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 14/15] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:40 2022] GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c => generated 346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:40.916796 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0378d6f6-4691-452f-afd9-10717255494b tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] Calling method '.version_select at 0x7f1a0b0dfca0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:41.067360 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0378d6f6-4691-452f-afd9-10717255494b tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121" status: 202 len: 0 microversion: 2.1 time: 0.158559 Jan 28 00:57:41.071970 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 15/16] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jan 28 00:57:40 2022] DELETE /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:41.073944 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-824630ec-7927-41d9-9495-54538f9590d3 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Action: 'create', calling method: .version_select at 0x7f1a0b071e50>, body: {"snapshot": {"volume_id": "7af8ec4e-59c8-4980-a605-b4346575fc8c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-275029449"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:41.455739 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-824630ec-7927-41d9-9495-54538f9590d3 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.386103 Jan 28 00:57:41.457232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 16/17] 10.222.0.78 () {60 vars in 1161 bytes} [Fri Jan 28 00:57:41 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:41.462915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8c70b419-6569-45de-a91f-f6ed69adeab3 tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] Calling method '.version_select at 0x7f1a0b071280>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:41.536531 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-8c70b419-6569-45de-a91f-f6ed69adeab3 tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] HTTP exception thrown: Volume 65ad2007-9b3c-48b8-a1cf-f147709e3121 could not be found. Jan 28 00:57:41.537829 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8c70b419-6569-45de-a91f-f6ed69adeab3 tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] Returning 404 to user: Volume 65ad2007-9b3c-48b8-a1cf-f147709e3121 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:41.539282 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8c70b419-6569-45de-a91f-f6ed69adeab3 tempest-VolumesGetTestJSON-697227478 tempest-VolumesGetTestJSON-697227478-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121" status: 404 len: 109 microversion: 2.1 time: 0.080717 Jan 28 00:57:41.540074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 17/18] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:41 2022] GET /compute/v2.1/os-volumes/65ad2007-9b3c-48b8-a1cf-f147709e3121 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:57:41.549950 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e599ff94-6433-4f35-9d62-9f864c8fb2f0 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0b071c10>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:41.619727 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e599ff94-6433-4f35-9d62-9f864c8fb2f0 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9" status: 200 len: 286 microversion: 2.1 time: 0.078210 Jan 28 00:57:41.620656 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 18/19] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jan 28 00:57:41 2022] GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:41.632826 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0fc99f1f-09a9-453c-a69e-4c03881e173b tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0b9fb550>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:41.731613 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0fc99f1f-09a9-453c-a69e-4c03881e173b tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.104083 Jan 28 00:57:41.732469 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 19/20] 10.222.0.78 () {58 vars in 1139 bytes} [Fri Jan 28 00:57:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:41.746703 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d04d539d-1efb-4bcf-ae8f-ebad413ff7d5 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0b071d30>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:41.840525 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d04d539d-1efb-4bcf-ae8f-ebad413ff7d5 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9" status: 200 len: 286 microversion: 2.1 time: 0.097960 Jan 28 00:57:41.841569 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 20/21] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jan 28 00:57:41 2022] GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:42.777478 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:57:42.778501 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:57:42.779251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:57:42.779828 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:57:42.781924 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:57:42.830450 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:42.832236 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:42.836687 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:42.837651 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:42.861354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e545a653-2fc4-4736-9b56-2281bab54c01 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0b071c10>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:42.984278 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Getting quotas for project 8c28f76a4d78416dabc595b2d237134d. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:57:43.003989 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e545a653-2fc4-4736-9b56-2281bab54c01 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9" status: 200 len: 286 microversion: 2.1 time: 0.151483 Jan 28 00:57:43.004985 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 21/22] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jan 28 00:57:42 2022] GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:43.019766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Getting quotas for user 43a28c98280c498c983c230a672a6601 and project 8c28f76a4d78416dabc595b2d237134d. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:57:43.066162 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:57:43.072911 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:57:43.245610 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ef4a5690-8c84-4b81-96e1-88f73ab69785 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.173274 Jan 28 00:57:43.253697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 2/23] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 00:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:57:43.263772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d8e2f06c-9612-4806-98fd-4f2d20be4cf2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:43.272048 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d8e2f06c-9612-4806-98fd-4f2d20be4cf2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:43.560334 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d8e2f06c-9612-4806-98fd-4f2d20be4cf2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:43.620871 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d8e2f06c-9612-4806-98fd-4f2d20be4cf2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1215 microversion: 2.1 time: 0.362403 Jan 28 00:57:43.621897 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 22/24] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:43 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1215 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:44.017998 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ca81da06-c5ba-4cee-97aa-a94fd71a8fc6 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0a780040>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:44.056067 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ca81da06-c5ba-4cee-97aa-a94fd71a8fc6 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9" status: 200 len: 286 microversion: 2.1 time: 0.042118 Jan 28 00:57:44.056649 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 3/25] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jan 28 00:57:44 2022] GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:44.647731 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e4ccfbd2-83aa-4f34-8592-bb1e47069e3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:44.653225 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e4ccfbd2-83aa-4f34-8592-bb1e47069e3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:44.977759 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e4ccfbd2-83aa-4f34-8592-bb1e47069e3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:45.000939 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e4ccfbd2-83aa-4f34-8592-bb1e47069e3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1215 microversion: 2.1 time: 0.358169 Jan 28 00:57:45.013914 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 23/26] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:44 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1215 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:45.080110 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5ea96f57-5234-4ad5-b475-52328ecf43c9 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0a780c10>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:45.201616 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5ea96f57-5234-4ad5-b475-52328ecf43c9 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9" status: 200 len: 287 microversion: 2.1 time: 0.130862 Jan 28 00:57:45.202974 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 4/27] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jan 28 00:57:45 2022] GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:45.223041 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-cda43c91-1df7-45a3-9d15-e706bc19b22a tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0b043c10>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:45.378173 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-cda43c91-1df7-45a3-9d15-e706bc19b22a tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9" status: 202 len: 0 microversion: 2.1 time: 0.165246 Jan 28 00:57:45.384445 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 24/28] 10.222.0.78 () {58 vars in 1253 bytes} [Fri Jan 28 00:57:45 2022] DELETE /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:57:45.389327 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b5e7ad46-ceaf-476e-ad12-60e117237486 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0b0dcee0>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:45.467272 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b5e7ad46-ceaf-476e-ad12-60e117237486 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9" status: 200 len: 286 microversion: 2.1 time: 0.081995 Jan 28 00:57:45.468483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 5/29] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jan 28 00:57:45 2022] GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:46.026394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2aa76766-7da0-402d-9517-790bc224f70b tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:46.027671 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2aa76766-7da0-402d-9517-790bc224f70b tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:46.059142 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2aa76766-7da0-402d-9517-790bc224f70b tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:46.063813 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2aa76766-7da0-402d-9517-790bc224f70b tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:46.064922 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2aa76766-7da0-402d-9517-790bc224f70b tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:46.066664 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2aa76766-7da0-402d-9517-790bc224f70b tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:46.482467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-035c559a-d887-4069-98a6-2468ce3def49 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0a780670>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:46.539890 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-035c559a-d887-4069-98a6-2468ce3def49 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] HTTP exception thrown: Snapshot d97a7447-043e-49c6-83e0-deadc1a39eb9 could not be found. Jan 28 00:57:46.540571 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-035c559a-d887-4069-98a6-2468ce3def49 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Returning 404 to user: Snapshot d97a7447-043e-49c6-83e0-deadc1a39eb9 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:46.545067 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-035c559a-d887-4069-98a6-2468ce3def49 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9" status: 404 len: 111 microversion: 2.1 time: 0.069365 Jan 28 00:57:46.552163 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 6/30] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jan 28 00:57:46 2022] GET /compute/v2.1/os-snapshots/d97a7447-043e-49c6-83e0-deadc1a39eb9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:57:46.569580 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bf37c7aa-3e3e-47b6-9d89-1ac8df8bfb7f tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0a780670>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:46.707824 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2aa76766-7da0-402d-9517-790bc224f70b tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:46.769986 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2aa76766-7da0-402d-9517-790bc224f70b tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1219 microversion: 2.1 time: 0.749002 Jan 28 00:57:46.774708 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 25/31] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:46 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1219 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:46.801495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bf37c7aa-3e3e-47b6-9d89-1ac8df8bfb7f tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c" status: 202 len: 0 microversion: 2.1 time: 0.248053 Jan 28 00:57:46.804230 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 7/32] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jan 28 00:57:46 2022] DELETE /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:46.817077 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5aa0bb69-2636-412c-a834-198e9088ace4 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0afbf0d0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:46.941915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5aa0bb69-2636-412c-a834-198e9088ace4 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c" status: 200 len: 345 microversion: 2.1 time: 0.131571 Jan 28 00:57:46.947320 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 26/33] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:46 2022] GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:47.795262 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-20411d64-39b5-4ba0-a889-10ffa5eaa391 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:47.795979 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-20411d64-39b5-4ba0-a889-10ffa5eaa391 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:47.833413 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-20411d64-39b5-4ba0-a889-10ffa5eaa391 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:47.866316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-20411d64-39b5-4ba0-a889-10ffa5eaa391 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:47.866316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-20411d64-39b5-4ba0-a889-10ffa5eaa391 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:47.866316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-20411d64-39b5-4ba0-a889-10ffa5eaa391 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:47.954750 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2eb73176-de8d-461e-83f8-ac435a196e45 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0afbfd30>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:48.013507 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-2eb73176-de8d-461e-83f8-ac435a196e45 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] HTTP exception thrown: Volume 7af8ec4e-59c8-4980-a605-b4346575fc8c could not be found. Jan 28 00:57:48.014080 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2eb73176-de8d-461e-83f8-ac435a196e45 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Returning 404 to user: Volume 7af8ec4e-59c8-4980-a605-b4346575fc8c could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:48.015030 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2eb73176-de8d-461e-83f8-ac435a196e45 tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c" status: 404 len: 109 microversion: 2.1 time: 0.064447 Jan 28 00:57:48.016522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 27/34] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:47 2022] GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:57:48.030097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f7b6aab4-ac10-49bc-ae4f-4ccc9ae2e39e tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0afbf8b0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:48.095215 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-f7b6aab4-ac10-49bc-ae4f-4ccc9ae2e39e tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] HTTP exception thrown: Volume 7af8ec4e-59c8-4980-a605-b4346575fc8c could not be found. Jan 28 00:57:48.096187 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f7b6aab4-ac10-49bc-ae4f-4ccc9ae2e39e tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Returning 404 to user: Volume 7af8ec4e-59c8-4980-a605-b4346575fc8c could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:48.097186 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f7b6aab4-ac10-49bc-ae4f-4ccc9ae2e39e tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c" status: 404 len: 109 microversion: 2.1 time: 0.070833 Jan 28 00:57:48.098216 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 28/35] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jan 28 00:57:48 2022] DELETE /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:57:48.106513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-17ff9edb-9bad-4b72-819b-8077acf11aec tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Calling method '.version_select at 0x7f1a0afafe50>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:48.193390 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-17ff9edb-9bad-4b72-819b-8077acf11aec tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] HTTP exception thrown: Volume 7af8ec4e-59c8-4980-a605-b4346575fc8c could not be found. Jan 28 00:57:48.193999 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-17ff9edb-9bad-4b72-819b-8077acf11aec tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] Returning 404 to user: Volume 7af8ec4e-59c8-4980-a605-b4346575fc8c could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:48.195199 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-17ff9edb-9bad-4b72-819b-8077acf11aec tempest-VolumesSnapshotsTestJSON-326253827 tempest-VolumesSnapshotsTestJSON-326253827-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c" status: 404 len: 109 microversion: 2.1 time: 0.093009 Jan 28 00:57:48.195928 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 29/36] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:57:48 2022] GET /compute/v2.1/os-volumes/7af8ec4e-59c8-4980-a605-b4346575fc8c => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:57:48.953905 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-20411d64-39b5-4ba0-a889-10ffa5eaa391 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:49.007049 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-20411d64-39b5-4ba0-a889-10ffa5eaa391 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1273 microversion: 2.1 time: 1.215991 Jan 28 00:57:49.009691 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 8/37] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:47 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1273 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:50.028217 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b9bf0557-3f4a-4780-826a-b421d55b7c91 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:50.028893 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b9bf0557-3f4a-4780-826a-b421d55b7c91 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:50.059403 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b9bf0557-3f4a-4780-826a-b421d55b7c91 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:50.060424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b9bf0557-3f4a-4780-826a-b421d55b7c91 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:50.060832 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b9bf0557-3f4a-4780-826a-b421d55b7c91 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:50.061301 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b9bf0557-3f4a-4780-826a-b421d55b7c91 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:50.478526 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1748574523", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:50.669181 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b9bf0557-3f4a-4780-826a-b421d55b7c91 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:50.687375 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b9bf0557-3f4a-4780-826a-b421d55b7c91 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1273 microversion: 2.1 time: 0.660271 Jan 28 00:57:50.700261 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 9/38] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:50 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1273 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:50.926292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] validate_networks() for [('e33e7749-4f5a-4380-9d6e-c7ef554a7709', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:57:52.964174 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4b9ec631-4221-4905-8241-e4edd7bef867 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'create', calling method: .version_select at 0x7f1a0a780b80>, body: {"keypair": {"name": "tempest-keypair-1777780224"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:53.039347 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-4b9ec631-4221-4905-8241-e4edd7bef867 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for project d1619efcedc544fabe3b60eef955ce40. Resources: {'key_pairs'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:57:53.062177 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-4b9ec631-4221-4905-8241-e4edd7bef867 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for user 3f4f91c9bc9d45cd8bea88e4c59c70ae and project d1619efcedc544fabe3b60eef955ce40. Resources: {'key_pairs'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:57:53.467548 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-4b9ec631-4221-4905-8241-e4edd7bef867 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for project d1619efcedc544fabe3b60eef955ce40. Resources: {'key_pairs'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:57:53.482011 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-4b9ec631-4221-4905-8241-e4edd7bef867 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for user 3f4f91c9bc9d45cd8bea88e4c59c70ae and project d1619efcedc544fabe3b60eef955ce40. Resources: {'key_pairs'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:57:53.558383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4b9ec631-4221-4905-8241-e4edd7bef867 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.099461 Jan 28 00:57:53.559794 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 10/39] 10.222.0.78 () {62 vars in 1198 bytes} [Fri Jan 28 00:57:51 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2108 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 28 00:57:53.584565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1f2a1771-20c1-4e36-9db4-03f75cd2b018 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:53.586025 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1f2a1771-20c1-4e36-9db4-03f75cd2b018 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:53.604985 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1f2a1771-20c1-4e36-9db4-03f75cd2b018 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:53.606083 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1f2a1771-20c1-4e36-9db4-03f75cd2b018 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:53.609184 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1f2a1771-20c1-4e36-9db4-03f75cd2b018 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:53.622110 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1f2a1771-20c1-4e36-9db4-03f75cd2b018 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:54.236851 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1f2a1771-20c1-4e36-9db4-03f75cd2b018 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:54.263227 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1f2a1771-20c1-4e36-9db4-03f75cd2b018 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.699907 Jan 28 00:57:54.296936 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 11/40] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:53 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:55.295862 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e8402214-8c2b-4f3f-b456-ae9eb4b6bb75 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:55.297465 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e8402214-8c2b-4f3f-b456-ae9eb4b6bb75 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:55.323333 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e8402214-8c2b-4f3f-b456-ae9eb4b6bb75 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:55.323333 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e8402214-8c2b-4f3f-b456-ae9eb4b6bb75 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:55.323333 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e8402214-8c2b-4f3f-b456-ae9eb4b6bb75 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:55.323333 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e8402214-8c2b-4f3f-b456-ae9eb4b6bb75 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:56.201483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e8402214-8c2b-4f3f-b456-ae9eb4b6bb75 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:56.214813 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e8402214-8c2b-4f3f-b456-ae9eb4b6bb75 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.923033 Jan 28 00:57:56.219649 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 12/41] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:55 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:57.237049 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-48ed02d4-3e1e-4ee2-a816-41dad56394ec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:57.238495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-48ed02d4-3e1e-4ee2-a816-41dad56394ec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:57.249624 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-48ed02d4-3e1e-4ee2-a816-41dad56394ec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:57.253115 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-48ed02d4-3e1e-4ee2-a816-41dad56394ec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:57.255871 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-48ed02d4-3e1e-4ee2-a816-41dad56394ec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:57.257927 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-48ed02d4-3e1e-4ee2-a816-41dad56394ec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:57.582998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:57:57.583568 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:57:57.583898 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:57:57.584400 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:57:57.585023 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:57:57.642453 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-48ed02d4-3e1e-4ee2-a816-41dad56394ec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:57.654716 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-48ed02d4-3e1e-4ee2-a816-41dad56394ec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.422002 Jan 28 00:57:57.673668 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 13/42] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:57 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:57.673772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:57.673772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:57.673772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:57.673772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:57.786484 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Getting quotas for project 8d3356a09ca24dd78dc3ad054e04830c. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:57:57.820671 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Getting quotas for user ad6a0f3a718b4996923e7adc8df7a658 and project 8d3356a09ca24dd78dc3ad054e04830c. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:57:57.871610 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:57:57.901516 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:57:58.317270 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3671f820-ab6c-47e8-a163-5ee6235555eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.985883 Jan 28 00:57:58.318116 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 30/43] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 00:57:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 8988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:57:58.333999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4bce0388-a3fd-4c6c-a870-0cadde6620dc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:58.334800 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4bce0388-a3fd-4c6c-a870-0cadde6620dc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:58.597125 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4bce0388-a3fd-4c6c-a870-0cadde6620dc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:58.672324 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4bce0388-a3fd-4c6c-a870-0cadde6620dc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1222 microversion: 2.1 time: 0.319151 Jan 28 00:57:58.673283 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 14/44] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:58 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1222 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:58.690810 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2d952d63-ddcd-4476-a095-c3594ce05aa6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:58.690810 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2d952d63-ddcd-4476-a095-c3594ce05aa6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:58.792485 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d952d63-ddcd-4476-a095-c3594ce05aa6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:58.793477 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d952d63-ddcd-4476-a095-c3594ce05aa6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:58.813491 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d952d63-ddcd-4476-a095-c3594ce05aa6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:58.814103 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d952d63-ddcd-4476-a095-c3594ce05aa6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:59.648136 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1851548637", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:59.809363 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] validate_networks() for [('e33e7749-4f5a-4380-9d6e-c7ef554a7709', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:58:00.082224 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2d952d63-ddcd-4476-a095-c3594ce05aa6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:00.090513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2d952d63-ddcd-4476-a095-c3594ce05aa6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 1.410558 Jan 28 00:58:00.094234 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 31/45] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:58 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:01.329290 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:58:01.331182 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:58:01.333684 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:58:01.335107 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:58:01.337011 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:58:01.358703 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:01.360013 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:01.361173 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:01.374616 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:01.417564 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Getting quotas for project 8d3356a09ca24dd78dc3ad054e04830c. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:58:01.424372 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Getting quotas for user ad6a0f3a718b4996923e7adc8df7a658 and project 8d3356a09ca24dd78dc3ad054e04830c. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:58:01.426961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-51923f10-3756-4525-9078-00f926c998d9 req-defc204e-155f-4dfd-8166-0350f6ef1ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67efe239-0022-4298-878f-42dd83b61165", "tag": "777d0cea-b600-4411-a443-06993344e637"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:01.430152 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:01.430152 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 00:58:01.458277 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:58:01.461176 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:58:01.480343 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-51923f10-3756-4525-9078-00f926c998d9 req-defc204e-155f-4dfd-8166-0350f6ef1ab9 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:01.483139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-51923f10-3756-4525-9078-00f926c998d9 req-defc204e-155f-4dfd-8166-0350f6ef1ab9 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:01.537973 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-51923f10-3756-4525-9078-00f926c998d9 req-defc204e-155f-4dfd-8166-0350f6ef1ab9 service nova] Creating event network-changed:777d0cea-b600-4411-a443-06993344e637 for instance 67efe239-0022-4298-878f-42dd83b61165 on hv-cinder-81689 Jan 28 00:58:01.538529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-51923f10-3756-4525-9078-00f926c998d9 req-defc204e-155f-4dfd-8166-0350f6ef1ab9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116254) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 00:58:01.539927 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fa2e1863-533b-4efb-bafd-bdc48541356f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:01.540569 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fa2e1863-533b-4efb-bafd-bdc48541356f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:01.541697 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fa2e1863-533b-4efb-bafd-bdc48541356f None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:01.542298 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fa2e1863-533b-4efb-bafd-bdc48541356f None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:01.562020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f4b69008-aeb0-434f-9ae8-1543f9a4221c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.923484 Jan 28 00:58:01.570313 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 15/46] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 00:57:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:58:01.577355 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-93faa395-34c8-4373-9a6d-55df740268d5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:01.582302 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-93faa395-34c8-4373-9a6d-55df740268d5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:01.589706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.compute.rpcapi [None req-fa2e1863-533b-4efb-bafd-bdc48541356f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 00:58:01.592813 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fa2e1863-533b-4efb-bafd-bdc48541356f None None] Releasing lock "compute-rpcapi-router" {{(pid=116254) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 00:58:01.602237 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93faa395-34c8-4373-9a6d-55df740268d5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:01.602816 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93faa395-34c8-4373-9a6d-55df740268d5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:01.608085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93faa395-34c8-4373-9a6d-55df740268d5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:01.608865 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93faa395-34c8-4373-9a6d-55df740268d5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:01.634974 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fa2e1863-533b-4efb-bafd-bdc48541356f None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.222759 Jan 28 00:58:01.643285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 32/47] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:58:01.651645 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2015106095", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1773e64-668d-4b4c-97fa-e06f64eac702"}], "security_groups": [{"name": "tempest-securitygroup--1251719342"}], "key_name": "tempest-keypair-1777780224", "user_data": "}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:01.911426 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-93faa395-34c8-4373-9a6d-55df740268d5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:01.921242 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-93faa395-34c8-4373-9a6d-55df740268d5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.347956 Jan 28 00:58:01.923474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 16/48] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:01 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:01.928320 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-03c62088-d66b-4f35-bb74-d079e7011e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:01.929240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-03c62088-d66b-4f35-bb74-d079e7011e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:02.057294 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-03c62088-d66b-4f35-bb74-d079e7011e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:02.065414 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-03c62088-d66b-4f35-bb74-d079e7011e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1222 microversion: 2.1 time: 0.140570 Jan 28 00:58:02.079723 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 17/49] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:01 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:02.085647 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] validate_networks() for [('d1773e64-668d-4b4c-97fa-e06f64eac702', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:58:02.861915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:58:02.862747 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:58:02.862973 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:58:02.863253 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:58:02.863827 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:58:02.877257 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:02.878400 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:02.879719 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:02.880378 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:02.906693 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for project d1619efcedc544fabe3b60eef955ce40. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:58:02.912568 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for user 3f4f91c9bc9d45cd8bea88e4c59c70ae and project d1619efcedc544fabe3b60eef955ce40. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:58:02.930036 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:58:02.938712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:58:02.939596 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-fc0ba3f4-4b61-42e2-a657-0c9128d9ac71 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:02.940299 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-fc0ba3f4-4b61-42e2-a657-0c9128d9ac71 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:02.958640 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc0ba3f4-4b61-42e2-a657-0c9128d9ac71 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:02.959402 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc0ba3f4-4b61-42e2-a657-0c9128d9ac71 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:02.961236 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc0ba3f4-4b61-42e2-a657-0c9128d9ac71 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:02.962703 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc0ba3f4-4b61-42e2-a657-0c9128d9ac71 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:03.019407 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7bfb9dd9-d530-4ce5-b9dc-11992b1004ac tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.373078 Jan 28 00:58:03.022666 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 33/50] 10.222.0.78 () {62 vars in 1187 bytes} [Fri Jan 28 00:58:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 00:58:03.032209 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-dd6ef73c-e48f-40fd-a029-539080985930 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:03.032825 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-dd6ef73c-e48f-40fd-a029-539080985930 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:03.169151 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-dd6ef73c-e48f-40fd-a029-539080985930 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:03.184657 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-dd6ef73c-e48f-40fd-a029-539080985930 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:03.188596 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-dd6ef73c-e48f-40fd-a029-539080985930 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:03.190003 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-dd6ef73c-e48f-40fd-a029-539080985930 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1282 microversion: 2.20 time: 0.161715 Jan 28 00:58:03.201298 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 34/51] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:03 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:03.206143 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-dce8acce-0190-41d0-a82e-5b379a4e52fa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:03.207093 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-dce8acce-0190-41d0-a82e-5b379a4e52fa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:03.215339 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dce8acce-0190-41d0-a82e-5b379a4e52fa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:03.216157 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dce8acce-0190-41d0-a82e-5b379a4e52fa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:03.217280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dce8acce-0190-41d0-a82e-5b379a4e52fa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:03.217926 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dce8acce-0190-41d0-a82e-5b379a4e52fa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:03.241009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-fc0ba3f4-4b61-42e2-a657-0c9128d9ac71 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:03.264921 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-fc0ba3f4-4b61-42e2-a657-0c9128d9ac71 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.329040 Jan 28 00:58:03.266602 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 18/52] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:02 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:03.331058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-dce8acce-0190-41d0-a82e-5b379a4e52fa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:03.343046 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-dce8acce-0190-41d0-a82e-5b379a4e52fa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1226 microversion: 2.1 time: 0.136722 Jan 28 00:58:03.344312 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 35/53] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:03 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1226 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:04.223739 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:04.224680 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:04.232411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.232759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.233623 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.234295 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.283159 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5a26f2b1-7a67-4dcb-8b65-780bdae8d997 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:04.283975 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5a26f2b1-7a67-4dcb-8b65-780bdae8d997 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:04.293924 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a26f2b1-7a67-4dcb-8b65-780bdae8d997 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.294385 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a26f2b1-7a67-4dcb-8b65-780bdae8d997 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.295242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a26f2b1-7a67-4dcb-8b65-780bdae8d997 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.295687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a26f2b1-7a67-4dcb-8b65-780bdae8d997 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.317566 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:04.332371 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:04.342834 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:04.346170 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6218e3d1-b98e-4782-828b-07ae81fe7228 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1286 microversion: 2.20 time: 0.133625 Jan 28 00:58:04.348417 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 19/54] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:04 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:04.366560 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3b790e60-78b6-4604-8f55-95822db16bb4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:04.367199 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3b790e60-78b6-4604-8f55-95822db16bb4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:04.375550 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3b790e60-78b6-4604-8f55-95822db16bb4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.377230 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3b790e60-78b6-4604-8f55-95822db16bb4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.378485 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3b790e60-78b6-4604-8f55-95822db16bb4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.379681 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3b790e60-78b6-4604-8f55-95822db16bb4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.448671 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3b790e60-78b6-4604-8f55-95822db16bb4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:04.458743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3b790e60-78b6-4604-8f55-95822db16bb4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1226 microversion: 2.1 time: 0.096520 Jan 28 00:58:04.459379 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 20/55] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:04 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:04.508094 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5a26f2b1-7a67-4dcb-8b65-780bdae8d997 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:04.522735 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5a26f2b1-7a67-4dcb-8b65-780bdae8d997 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.243779 Jan 28 00:58:04.533263 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 36/56] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:04 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:05.372886 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:05.376992 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:05.423644 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:05.423644 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.427827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:05.429792 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.480499 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-87e580d6-a8fc-456e-afa5-0c0219aa563a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:05.483106 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-87e580d6-a8fc-456e-afa5-0c0219aa563a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:05.509892 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-87e580d6-a8fc-456e-afa5-0c0219aa563a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:05.511322 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-87e580d6-a8fc-456e-afa5-0c0219aa563a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.516475 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-87e580d6-a8fc-456e-afa5-0c0219aa563a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:05.519141 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-87e580d6-a8fc-456e-afa5-0c0219aa563a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.697958 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:05.751247 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:05.766624 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:05.770155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2cb65a6b-507e-46f1-89ea-aefed2e43d92 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1286 microversion: 2.20 time: 0.403982 Jan 28 00:58:05.781811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 21/57] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:05 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1286 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:05.805903 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d2c859fa-dfd8-4ff2-92e6-0d2ff44b90d8 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:05.812151 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d2c859fa-dfd8-4ff2-92e6-0d2ff44b90d8 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:05.849361 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d2c859fa-dfd8-4ff2-92e6-0d2ff44b90d8 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:05.855782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d2c859fa-dfd8-4ff2-92e6-0d2ff44b90d8 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.862398 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d2c859fa-dfd8-4ff2-92e6-0d2ff44b90d8 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:05.863537 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d2c859fa-dfd8-4ff2-92e6-0d2ff44b90d8 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.952442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-87e580d6-a8fc-456e-afa5-0c0219aa563a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:05.977783 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-87e580d6-a8fc-456e-afa5-0c0219aa563a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1226 microversion: 2.1 time: 0.497917 Jan 28 00:58:05.983058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 37/58] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:05 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1226 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:06.435522 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d2c859fa-dfd8-4ff2-92e6-0d2ff44b90d8 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:06.456550 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d2c859fa-dfd8-4ff2-92e6-0d2ff44b90d8 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.672886 Jan 28 00:58:06.463146 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 22/59] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:05 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:06.805442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:06.806129 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:06.830046 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:06.836507 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:06.838427 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:06.839303 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:06.996950 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-00c8df7d-9aba-4d40-a446-4c5a3b60d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:06.997575 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-00c8df7d-9aba-4d40-a446-4c5a3b60d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:07.007984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-00c8df7d-9aba-4d40-a446-4c5a3b60d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:07.012554 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-00c8df7d-9aba-4d40-a446-4c5a3b60d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:07.015958 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-00c8df7d-9aba-4d40-a446-4c5a3b60d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:07.021120 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-00c8df7d-9aba-4d40-a446-4c5a3b60d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:07.043524 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:07.062942 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:07.067595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:07.076272 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8239f753-f4cf-4957-800f-7881cfc9f318 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1334 microversion: 2.20 time: 0.270629 Jan 28 00:58:07.077287 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 38/60] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:06 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1334 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:07.184988 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-00c8df7d-9aba-4d40-a446-4c5a3b60d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:07.192947 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-00c8df7d-9aba-4d40-a446-4c5a3b60d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1274 microversion: 2.1 time: 0.199973 Jan 28 00:58:07.210123 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 23/61] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:06 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:07.482159 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5a5619e4-9e9d-4b2b-90f7-86806ab129c2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:07.485232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5a5619e4-9e9d-4b2b-90f7-86806ab129c2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:07.536222 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a5619e4-9e9d-4b2b-90f7-86806ab129c2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:07.541446 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a5619e4-9e9d-4b2b-90f7-86806ab129c2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:07.543573 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a5619e4-9e9d-4b2b-90f7-86806ab129c2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:07.544113 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a5619e4-9e9d-4b2b-90f7-86806ab129c2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.115059 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:08.115885 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:08.150964 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.155419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.165479 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.165991 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.354570 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5a5619e4-9e9d-4b2b-90f7-86806ab129c2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:08.389481 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5a5619e4-9e9d-4b2b-90f7-86806ab129c2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.912311 Jan 28 00:58:08.399537 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 39/62] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:07 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:08.412205 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8d2d0f01-84b4-425c-995a-8509d7ef211a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:08.415036 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8d2d0f01-84b4-425c-995a-8509d7ef211a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:08.437979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8d2d0f01-84b4-425c-995a-8509d7ef211a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.438850 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8d2d0f01-84b4-425c-995a-8509d7ef211a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.440854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8d2d0f01-84b4-425c-995a-8509d7ef211a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.449091 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8d2d0f01-84b4-425c-995a-8509d7ef211a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.790802 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:08.840885 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:08.850240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:08.855801 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c6f66f35-bc4f-4fe2-94b9-8a71dda07f84 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1340 microversion: 2.20 time: 0.744788 Jan 28 00:58:08.856838 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8d2d0f01-84b4-425c-995a-8509d7ef211a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:08.860302 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 24/63] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:08 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1340 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:08.870763 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8d2d0f01-84b4-425c-995a-8509d7ef211a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1280 microversion: 2.1 time: 0.469935 Jan 28 00:58:08.878002 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 40/64] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:08 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1280 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:09.415123 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-34834fb7-f4f9-465c-afdf-daab282d35c6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:09.416027 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-34834fb7-f4f9-465c-afdf-daab282d35c6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:09.437099 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34834fb7-f4f9-465c-afdf-daab282d35c6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.437754 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34834fb7-f4f9-465c-afdf-daab282d35c6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:09.438954 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34834fb7-f4f9-465c-afdf-daab282d35c6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.440671 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34834fb7-f4f9-465c-afdf-daab282d35c6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:09.821896 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-34834fb7-f4f9-465c-afdf-daab282d35c6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:09.829940 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-34834fb7-f4f9-465c-afdf-daab282d35c6 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.419158 Jan 28 00:58:09.830556 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 25/65] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:09 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:09.884927 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:09.886165 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:09.893785 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.894586 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:09.895894 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.896356 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-433d6eea-dd34-49c0-b14b-62bf4cabdda9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:09.896667 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:09.897502 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-433d6eea-dd34-49c0-b14b-62bf4cabdda9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:09.915257 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-433d6eea-dd34-49c0-b14b-62bf4cabdda9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.916447 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-433d6eea-dd34-49c0-b14b-62bf4cabdda9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:09.917551 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-433d6eea-dd34-49c0-b14b-62bf4cabdda9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.918204 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-433d6eea-dd34-49c0-b14b-62bf4cabdda9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:10.104830 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:10.119272 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:10.123689 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:10.126943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f32dc78e-0a97-43b0-8b50-c3887bc9a454 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.246336 Jan 28 00:58:10.130243 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 41/66] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:09 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:10.387802 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-433d6eea-dd34-49c0-b14b-62bf4cabdda9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:10.396902 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-433d6eea-dd34-49c0-b14b-62bf4cabdda9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.505590 Jan 28 00:58:10.397999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 26/67] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:09 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:10.853132 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e7a4c9ea-79c8-4586-b370-66b2b51f985d tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:10.853819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e7a4c9ea-79c8-4586-b370-66b2b51f985d tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:10.860614 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e7a4c9ea-79c8-4586-b370-66b2b51f985d tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:10.861244 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e7a4c9ea-79c8-4586-b370-66b2b51f985d tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:10.862297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e7a4c9ea-79c8-4586-b370-66b2b51f985d tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:10.862855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e7a4c9ea-79c8-4586-b370-66b2b51f985d tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.084020 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e7a4c9ea-79c8-4586-b370-66b2b51f985d tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:11.094074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e7a4c9ea-79c8-4586-b370-66b2b51f985d tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.244881 Jan 28 00:58:11.094659 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 42/68] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:10 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:11.156632 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:11.157903 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:11.165027 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.165572 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.166406 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.167100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.347763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:11.359778 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:11.361463 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:11.362629 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e476c011-cab0-413c-98a5-6a419a9593a9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.210217 Jan 28 00:58:11.363307 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 27/69] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:11 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:11.419272 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-85662ef0-70f0-4240-8f3e-389ce3462d16 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:11.420430 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-85662ef0-70f0-4240-8f3e-389ce3462d16 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:11.428393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-85662ef0-70f0-4240-8f3e-389ce3462d16 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.428863 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-85662ef0-70f0-4240-8f3e-389ce3462d16 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.429664 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-85662ef0-70f0-4240-8f3e-389ce3462d16 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.430127 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-85662ef0-70f0-4240-8f3e-389ce3462d16 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.615626 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-85662ef0-70f0-4240-8f3e-389ce3462d16 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:11.623673 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-85662ef0-70f0-4240-8f3e-389ce3462d16 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.209663 Jan 28 00:58:11.624256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 43/70] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:11 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:12.126039 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4b981659-a1bf-4126-a793-f35a27f6edbe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:12.127036 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4b981659-a1bf-4126-a793-f35a27f6edbe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:12.144573 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4b981659-a1bf-4126-a793-f35a27f6edbe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.145678 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4b981659-a1bf-4126-a793-f35a27f6edbe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.146725 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4b981659-a1bf-4126-a793-f35a27f6edbe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.147409 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4b981659-a1bf-4126-a793-f35a27f6edbe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.387269 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:12.390634 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:12.425901 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.427103 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.430769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.431910 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.609509 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4b981659-a1bf-4126-a793-f35a27f6edbe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:12.630799 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4b981659-a1bf-4126-a793-f35a27f6edbe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.516077 Jan 28 00:58:12.632297 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 28/71] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:12 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:12.655370 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b24ef3c3-e024-413d-95f3-d81403809e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:12.662985 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b24ef3c3-e024-413d-95f3-d81403809e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:12.721108 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b24ef3c3-e024-413d-95f3-d81403809e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.721752 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b24ef3c3-e024-413d-95f3-d81403809e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.722968 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b24ef3c3-e024-413d-95f3-d81403809e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.725780 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b24ef3c3-e024-413d-95f3-d81403809e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.865463 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:12.904280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:12.908377 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:12.915540 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-73329890-9c3e-4066-be13-a921e8cbcfcd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.532356 Jan 28 00:58:12.916711 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 44/72] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:12 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:13.315530 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b24ef3c3-e024-413d-95f3-d81403809e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:13.326212 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b24ef3c3-e024-413d-95f3-d81403809e2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.682171 Jan 28 00:58:13.350784 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 29/73] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:12 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:13.672248 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0d4b4374-d536-4650-8cb0-175760ad7fab tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:13.676028 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0d4b4374-d536-4650-8cb0-175760ad7fab tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:13.690198 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d4b4374-d536-4650-8cb0-175760ad7fab tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:13.691041 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d4b4374-d536-4650-8cb0-175760ad7fab tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:13.692557 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d4b4374-d536-4650-8cb0-175760ad7fab tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:13.693350 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d4b4374-d536-4650-8cb0-175760ad7fab tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:13.873964 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-2c8960e5-fc84-4209-9315-12a4e7446de0 req-0a813097-7384-41f3-955a-6b3ab7cd77d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8ab5025-62f7-40d2-b976-95ed4c6f0499", "tag": "4018b024-2307-4179-b2ef-10369aaee53c"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:13.887782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:13.887782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 00:58:13.939062 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-2c8960e5-fc84-4209-9315-12a4e7446de0 req-0a813097-7384-41f3-955a-6b3ab7cd77d7 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:13.939522 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-2c8960e5-fc84-4209-9315-12a4e7446de0 req-0a813097-7384-41f3-955a-6b3ab7cd77d7 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:14.010699 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-2c8960e5-fc84-4209-9315-12a4e7446de0 req-0a813097-7384-41f3-955a-6b3ab7cd77d7 service nova] Creating event network-changed:4018b024-2307-4179-b2ef-10369aaee53c for instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 on hv-cinder-81689 Jan 28 00:58:14.011448 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-2c8960e5-fc84-4209-9315-12a4e7446de0 req-0a813097-7384-41f3-955a-6b3ab7cd77d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116253) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 00:58:14.012870 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cbe7203-a6d7-4e13-a6f2-79487f80bfd0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:14.018250 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cbe7203-a6d7-4e13-a6f2-79487f80bfd0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:14.019403 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cbe7203-a6d7-4e13-a6f2-79487f80bfd0 None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:14.021228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cbe7203-a6d7-4e13-a6f2-79487f80bfd0 None None] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:14.054529 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.compute.rpcapi [None req-7cbe7203-a6d7-4e13-a6f2-79487f80bfd0 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 00:58:14.055664 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cbe7203-a6d7-4e13-a6f2-79487f80bfd0 None None] Releasing lock "compute-rpcapi-router" {{(pid=116253) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 00:58:14.118189 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7cbe7203-a6d7-4e13-a6f2-79487f80bfd0 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272377 Jan 28 00:58:14.119430 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 30/74] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:14.134213 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:14.137732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:14.156548 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:14.157054 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:14.157917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:14.158354 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:14.747189 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:14.752288 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0d4b4374-d536-4650-8cb0-175760ad7fab tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:14.769736 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:14.772514 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:14.776073 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0d4b4374-d536-4650-8cb0-175760ad7fab tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 1.115070 Jan 28 00:58:14.776882 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 45/75] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:13 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:14.777191 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0ea2ba20-31e8-4973-a423-2bba182e1c0d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.653616 Jan 28 00:58:14.778048 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 31/76] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:14 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:14.814215 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-69d54f31-d06c-4071-96a1-a7dbfabfe7f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:14.815284 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-69d54f31-d06c-4071-96a1-a7dbfabfe7f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:14.837843 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-69d54f31-d06c-4071-96a1-a7dbfabfe7f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:14.863160 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-69d54f31-d06c-4071-96a1-a7dbfabfe7f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:14.864327 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-69d54f31-d06c-4071-96a1-a7dbfabfe7f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:14.875019 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-69d54f31-d06c-4071-96a1-a7dbfabfe7f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.084414 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-f22c960a-0d85-4fc5-9da7-2cacb78919cc req-1ccc586f-67a8-4481-ad90-a01be9b2b15c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31", "tag": "9c62ad7c-9f29-464d-b6ad-f74102e3735b"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:15.087724 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:15.087724 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 00:58:15.136492 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-f22c960a-0d85-4fc5-9da7-2cacb78919cc req-1ccc586f-67a8-4481-ad90-a01be9b2b15c service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.139836 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-f22c960a-0d85-4fc5-9da7-2cacb78919cc req-1ccc586f-67a8-4481-ad90-a01be9b2b15c service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.180739 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-69d54f31-d06c-4071-96a1-a7dbfabfe7f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:15.190842 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-f22c960a-0d85-4fc5-9da7-2cacb78919cc req-1ccc586f-67a8-4481-ad90-a01be9b2b15c service nova] Creating event network-changed:9c62ad7c-9f29-464d-b6ad-f74102e3735b for instance 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 on hv-cinder-81689 Jan 28 00:58:15.203193 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-69d54f31-d06c-4071-96a1-a7dbfabfe7f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.392159 Jan 28 00:58:15.204256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 46/77] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:14 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:15.206830 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-f22c960a-0d85-4fc5-9da7-2cacb78919cc req-1ccc586f-67a8-4481-ad90-a01be9b2b15c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.427042 Jan 28 00:58:15.220153 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 32/78] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:15.807190 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3edf5ef9-7d54-4b15-85bb-734051d24415 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:15.808471 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3edf5ef9-7d54-4b15-85bb-734051d24415 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:15.815528 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:15.816284 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:15.817462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3edf5ef9-7d54-4b15-85bb-734051d24415 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.818178 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3edf5ef9-7d54-4b15-85bb-734051d24415 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.819268 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3edf5ef9-7d54-4b15-85bb-734051d24415 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.819917 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3edf5ef9-7d54-4b15-85bb-734051d24415 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.832799 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.833687 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.834789 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.835432 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:16.236212 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3edf5ef9-7d54-4b15-85bb-734051d24415 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:16.251348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3edf5ef9-7d54-4b15-85bb-734051d24415 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.447526 Jan 28 00:58:16.263012 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 47/79] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:15 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:16.270322 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d293dcdc-b088-4497-9c01-d09c6d82b89a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:16.271467 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d293dcdc-b088-4497-9c01-d09c6d82b89a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:16.279784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d293dcdc-b088-4497-9c01-d09c6d82b89a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:16.281119 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d293dcdc-b088-4497-9c01-d09c6d82b89a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:16.282666 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d293dcdc-b088-4497-9c01-d09c6d82b89a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:16.283602 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d293dcdc-b088-4497-9c01-d09c6d82b89a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:16.474396 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:16.509364 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:16.512988 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:16.514160 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b2cb97d9-ee01-4e65-a430-8e5d35f6c298 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.709701 Jan 28 00:58:16.514757 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 33/80] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:15 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:16.600306 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d293dcdc-b088-4497-9c01-d09c6d82b89a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:16.617039 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d293dcdc-b088-4497-9c01-d09c6d82b89a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.351701 Jan 28 00:58:16.617969 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 48/81] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:16 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:17.278503 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c1498c6d-9591-4240-9173-9d545349d1e9 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:17.279836 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c1498c6d-9591-4240-9173-9d545349d1e9 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:17.292391 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c1498c6d-9591-4240-9173-9d545349d1e9 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.293385 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c1498c6d-9591-4240-9173-9d545349d1e9 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.294762 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c1498c6d-9591-4240-9173-9d545349d1e9 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.316049 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c1498c6d-9591-4240-9173-9d545349d1e9 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.324710 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-fc4ce857-735a-4b1a-ba15-fadd14fabd35 req-cf73a289-ad16-411b-bd1a-25769ed12049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "213c2110-983e-47cc-b98c-6b8b91a5e7a3", "tag": "450ff6d4-7d9c-4d30-9b72-a587ed2801cc"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:17.332498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:17.332498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 00:58:17.367354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-fc4ce857-735a-4b1a-ba15-fadd14fabd35 req-cf73a289-ad16-411b-bd1a-25769ed12049 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.369864 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-fc4ce857-735a-4b1a-ba15-fadd14fabd35 req-cf73a289-ad16-411b-bd1a-25769ed12049 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.413002 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-fc4ce857-735a-4b1a-ba15-fadd14fabd35 req-cf73a289-ad16-411b-bd1a-25769ed12049 service nova] Creating event network-changed:450ff6d4-7d9c-4d30-9b72-a587ed2801cc for instance 213c2110-983e-47cc-b98c-6b8b91a5e7a3 on hv-cinder-81689 Jan 28 00:58:17.435987 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-fc4ce857-735a-4b1a-ba15-fadd14fabd35 req-cf73a289-ad16-411b-bd1a-25769ed12049 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118978 Jan 28 00:58:17.443759 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 49/82] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:17.548026 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:17.549772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:17.581477 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.584478 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.587004 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.587972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.851152 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c1498c6d-9591-4240-9173-9d545349d1e9 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:17.870146 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c1498c6d-9591-4240-9173-9d545349d1e9 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.600340 Jan 28 00:58:17.874106 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 34/83] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:17 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:17.907702 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7acd0013-296c-4168-8b08-f57cd5eb8244 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:17.912106 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7acd0013-296c-4168-8b08-f57cd5eb8244 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:17.932408 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7acd0013-296c-4168-8b08-f57cd5eb8244 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.937467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7acd0013-296c-4168-8b08-f57cd5eb8244 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.941785 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7acd0013-296c-4168-8b08-f57cd5eb8244 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.943740 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7acd0013-296c-4168-8b08-f57cd5eb8244 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:18.020874 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:18.055893 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:18.060980 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:18.065975 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-592ea7c4-9d12-4001-a594-12763f8cff13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.531973 Jan 28 00:58:18.069628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 50/84] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:17 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:18.594789 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7acd0013-296c-4168-8b08-f57cd5eb8244 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:18.612274 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7acd0013-296c-4168-8b08-f57cd5eb8244 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.734792 Jan 28 00:58:18.613102 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 35/85] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:17 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:18.887578 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6e03a7ff-15a8-4733-8f7b-cb2352594dec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:18.889364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6e03a7ff-15a8-4733-8f7b-cb2352594dec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:18.898460 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e03a7ff-15a8-4733-8f7b-cb2352594dec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.899339 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e03a7ff-15a8-4733-8f7b-cb2352594dec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:18.900651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e03a7ff-15a8-4733-8f7b-cb2352594dec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.901297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e03a7ff-15a8-4733-8f7b-cb2352594dec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:19.099319 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:19.099979 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:19.109394 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:19.109973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:19.110897 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:19.111360 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:19.248718 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6e03a7ff-15a8-4733-8f7b-cb2352594dec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:19.260500 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6e03a7ff-15a8-4733-8f7b-cb2352594dec tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.375627 Jan 28 00:58:19.273918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 51/86] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:18 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:19.402630 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:19.415365 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:19.420430 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:19.424286 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-02d0a194-3b9c-42f7-834f-a866c0f26005 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.328069 Jan 28 00:58:19.425982 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 36/87] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:19 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:19.638386 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e59decd1-4ba6-438c-8ce1-c4d1752269c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:19.643184 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e59decd1-4ba6-438c-8ce1-c4d1752269c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:19.674983 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e59decd1-4ba6-438c-8ce1-c4d1752269c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:19.676079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e59decd1-4ba6-438c-8ce1-c4d1752269c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:19.679744 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e59decd1-4ba6-438c-8ce1-c4d1752269c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:19.681542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e59decd1-4ba6-438c-8ce1-c4d1752269c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:19.852506 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e59decd1-4ba6-438c-8ce1-c4d1752269c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:19.861711 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e59decd1-4ba6-438c-8ce1-c4d1752269c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.230653 Jan 28 00:58:19.862367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 52/88] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:19 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:20.277434 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-738701f4-6095-40d1-8ab0-4a21b48b1d3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:20.278054 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-738701f4-6095-40d1-8ab0-4a21b48b1d3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:20.293194 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-738701f4-6095-40d1-8ab0-4a21b48b1d3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.293656 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-738701f4-6095-40d1-8ab0-4a21b48b1d3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.294467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-738701f4-6095-40d1-8ab0-4a21b48b1d3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.297254 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-738701f4-6095-40d1-8ab0-4a21b48b1d3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.446630 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:20.447324 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:20.492995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.497503 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.498726 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.499878 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.650981 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-738701f4-6095-40d1-8ab0-4a21b48b1d3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:20.668652 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-738701f4-6095-40d1-8ab0-4a21b48b1d3c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.393385 Jan 28 00:58:20.670194 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 37/89] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:20 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:20.755953 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:20.767047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:20.770105 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:20.771916 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-27cc32d9-ee9f-435e-85b9-b14c3cf27729 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.330933 Jan 28 00:58:20.773016 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 53/90] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:20 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:20.887991 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-66ea6776-1b66-41b2-bdb0-9adf7093c923 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:20.889447 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-66ea6776-1b66-41b2-bdb0-9adf7093c923 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:20.902431 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-66ea6776-1b66-41b2-bdb0-9adf7093c923 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.903770 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-66ea6776-1b66-41b2-bdb0-9adf7093c923 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.910801 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-66ea6776-1b66-41b2-bdb0-9adf7093c923 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.918394 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-66ea6776-1b66-41b2-bdb0-9adf7093c923 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:21.218579 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-66ea6776-1b66-41b2-bdb0-9adf7093c923 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:21.246128 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-66ea6776-1b66-41b2-bdb0-9adf7093c923 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.368247 Jan 28 00:58:21.259905 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 38/91] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:20 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:21.685283 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-fef91523-a2d2-4026-9e42-5ebcef861b4a req-42b15c38-2f98-4408-b600-0c70d671f9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67efe239-0022-4298-878f-42dd83b61165", "name": "network-vif-plugged", "status": "completed", "tag": "777d0cea-b600-4411-a443-06993344e637"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:21.687628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:21.687628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 00:58:21.688618 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-69b375ea-7d12-4773-8d4d-286b268cadf5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:21.689242 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-69b375ea-7d12-4773-8d4d-286b268cadf5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:21.698774 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-69b375ea-7d12-4773-8d4d-286b268cadf5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:21.699420 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-69b375ea-7d12-4773-8d4d-286b268cadf5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:21.700227 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-69b375ea-7d12-4773-8d4d-286b268cadf5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:21.700679 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-69b375ea-7d12-4773-8d4d-286b268cadf5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:21.701967 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-fef91523-a2d2-4026-9e42-5ebcef861b4a req-42b15c38-2f98-4408-b600-0c70d671f9f1 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:21.706958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-fef91523-a2d2-4026-9e42-5ebcef861b4a req-42b15c38-2f98-4408-b600-0c70d671f9f1 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:21.720329 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-fef91523-a2d2-4026-9e42-5ebcef861b4a req-42b15c38-2f98-4408-b600-0c70d671f9f1 service nova] Creating event network-vif-plugged:777d0cea-b600-4411-a443-06993344e637 for instance 67efe239-0022-4298-878f-42dd83b61165 on hv-cinder-81689 Jan 28 00:58:21.726769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-fef91523-a2d2-4026-9e42-5ebcef861b4a req-42b15c38-2f98-4408-b600-0c70d671f9f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.350999 Jan 28 00:58:21.727657 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 54/92] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:21.802079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:21.803244 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:21.819522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:21.820206 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:21.821193 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:21.821627 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:22.024163 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-69b375ea-7d12-4773-8d4d-286b268cadf5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:22.046804 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-69b375ea-7d12-4773-8d4d-286b268cadf5 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.356212 Jan 28 00:58:22.050236 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 39/93] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:21 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:22.180787 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:22.193487 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:22.199373 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:22.205218 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e80cebf7-ffd6-401b-bc20-9b5a4e86806d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.409245 Jan 28 00:58:22.205913 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 55/94] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:21 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:22.279009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a8038057-160c-4d19-96d8-0ce839ae4f0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:22.279664 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a8038057-160c-4d19-96d8-0ce839ae4f0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:22.292777 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8038057-160c-4d19-96d8-0ce839ae4f0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:22.293251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8038057-160c-4d19-96d8-0ce839ae4f0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:22.294071 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8038057-160c-4d19-96d8-0ce839ae4f0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:22.294682 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8038057-160c-4d19-96d8-0ce839ae4f0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:22.821673 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a8038057-160c-4d19-96d8-0ce839ae4f0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:22.836628 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a8038057-160c-4d19-96d8-0ce839ae4f0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.563125 Jan 28 00:58:22.839428 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 40/95] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:22 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:23.065931 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a8320ea5-6ef1-4d5e-be13-ccb3fc5fec97 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:23.066802 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a8320ea5-6ef1-4d5e-be13-ccb3fc5fec97 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:23.073615 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a8320ea5-6ef1-4d5e-be13-ccb3fc5fec97 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:23.074063 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a8320ea5-6ef1-4d5e-be13-ccb3fc5fec97 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:23.074923 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a8320ea5-6ef1-4d5e-be13-ccb3fc5fec97 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:23.075810 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a8320ea5-6ef1-4d5e-be13-ccb3fc5fec97 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:23.224166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:23.224784 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:23.232592 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:23.234070 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:23.235539 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:23.236291 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:23.295729 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a8320ea5-6ef1-4d5e-be13-ccb3fc5fec97 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:23.316632 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a8320ea5-6ef1-4d5e-be13-ccb3fc5fec97 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.253201 Jan 28 00:58:23.318171 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 56/96] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:23 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:23.429488 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:23.439542 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:23.441489 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:23.443334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-23aabb69-ee09-4fd3-9954-9adc08bfbf82 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.222657 Jan 28 00:58:23.444705 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 41/97] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:23 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:23.764542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-7a98b092-3f51-48f4-a33d-a6c4470707ef req-1618bb51-5671-476f-9f8b-1fc71632dc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ab5025-62f7-40d2-b976-95ed4c6f0499", "name": "network-vif-plugged", "status": "completed", "tag": "4018b024-2307-4179-b2ef-10369aaee53c"}, {"server_uuid": "82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31", "name": "network-vif-plugged", "status": "completed", "tag": "9c62ad7c-9f29-464d-b6ad-f74102e3735b"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:23.770146 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:23.770146 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 00:58:23.790085 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-7a98b092-3f51-48f4-a33d-a6c4470707ef req-1618bb51-5671-476f-9f8b-1fc71632dc71 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:23.790972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-7a98b092-3f51-48f4-a33d-a6c4470707ef req-1618bb51-5671-476f-9f8b-1fc71632dc71 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:23.817258 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-7a98b092-3f51-48f4-a33d-a6c4470707ef req-1618bb51-5671-476f-9f8b-1fc71632dc71 service nova] Creating event network-vif-plugged:4018b024-2307-4179-b2ef-10369aaee53c for instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 on hv-cinder-81689 Jan 28 00:58:23.818225 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-7a98b092-3f51-48f4-a33d-a6c4470707ef req-1618bb51-5671-476f-9f8b-1fc71632dc71 service nova] Creating event network-vif-plugged:9c62ad7c-9f29-464d-b6ad-f74102e3735b for instance 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 on hv-cinder-81689 Jan 28 00:58:23.834911 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-7a98b092-3f51-48f4-a33d-a6c4470707ef req-1618bb51-5671-476f-9f8b-1fc71632dc71 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093059 Jan 28 00:58:23.836615 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 57/98] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:23.868518 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-168660ef-6f7f-4610-9f79-9b93fb78ca00 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:23.869973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-168660ef-6f7f-4610-9f79-9b93fb78ca00 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:23.884398 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-168660ef-6f7f-4610-9f79-9b93fb78ca00 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:23.884934 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-168660ef-6f7f-4610-9f79-9b93fb78ca00 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:23.885849 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-168660ef-6f7f-4610-9f79-9b93fb78ca00 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:23.886518 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-168660ef-6f7f-4610-9f79-9b93fb78ca00 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:24.281229 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-168660ef-6f7f-4610-9f79-9b93fb78ca00 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:24.294328 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-168660ef-6f7f-4610-9f79-9b93fb78ca00 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.439692 Jan 28 00:58:24.297994 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 42/99] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:23 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:24.338216 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0977a914-a300-47b1-98c9-6d87f8229f53 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:24.340070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0977a914-a300-47b1-98c9-6d87f8229f53 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:24.356311 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0977a914-a300-47b1-98c9-6d87f8229f53 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:24.356785 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0977a914-a300-47b1-98c9-6d87f8229f53 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:24.357617 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0977a914-a300-47b1-98c9-6d87f8229f53 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:24.361047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0977a914-a300-47b1-98c9-6d87f8229f53 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:24.466188 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:24.467782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:24.493155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:24.497520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:24.499913 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:24.501876 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:24.685399 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0977a914-a300-47b1-98c9-6d87f8229f53 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:24.699130 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0977a914-a300-47b1-98c9-6d87f8229f53 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1315 microversion: 2.1 time: 0.367025 Jan 28 00:58:24.703092 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 58/100] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:24 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:24.869802 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:24.880522 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:24.882547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:24.884184 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-97533f78-355e-4130-8ef9-0da20a522c93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.425049 Jan 28 00:58:24.884942 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 43/101] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:24 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:25.319576 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a2c4a057-c86e-4678-bf8e-ca146f483242 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:25.320253 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a2c4a057-c86e-4678-bf8e-ca146f483242 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:25.332706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2c4a057-c86e-4678-bf8e-ca146f483242 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.334387 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2c4a057-c86e-4678-bf8e-ca146f483242 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.337881 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2c4a057-c86e-4678-bf8e-ca146f483242 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.339175 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2c4a057-c86e-4678-bf8e-ca146f483242 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.561274 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a2c4a057-c86e-4678-bf8e-ca146f483242 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:25.573162 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a2c4a057-c86e-4678-bf8e-ca146f483242 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.257290 Jan 28 00:58:25.573880 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 59/102] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:25 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:25.724970 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-baac5125-7fe6-468f-9930-fd5b0f431bfe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:25.726503 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-baac5125-7fe6-468f-9930-fd5b0f431bfe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:25.741202 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-baac5125-7fe6-468f-9930-fd5b0f431bfe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.742500 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-baac5125-7fe6-468f-9930-fd5b0f431bfe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.744288 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-baac5125-7fe6-468f-9930-fd5b0f431bfe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.745433 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-baac5125-7fe6-468f-9930-fd5b0f431bfe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.855546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-9485d17f-f058-4edf-b96a-4c1e3be223bc req-80d91b4e-be2d-469a-ae3f-767ea66d4764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "213c2110-983e-47cc-b98c-6b8b91a5e7a3", "name": "network-vif-plugged", "status": "completed", "tag": "450ff6d4-7d9c-4d30-9b72-a587ed2801cc"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:25.857385 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:25.857385 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 00:58:25.878246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-9485d17f-f058-4edf-b96a-4c1e3be223bc req-80d91b4e-be2d-469a-ae3f-767ea66d4764 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.879363 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-9485d17f-f058-4edf-b96a-4c1e3be223bc req-80d91b4e-be2d-469a-ae3f-767ea66d4764 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.904118 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-9485d17f-f058-4edf-b96a-4c1e3be223bc req-80d91b4e-be2d-469a-ae3f-767ea66d4764 service nova] Creating event network-vif-plugged:450ff6d4-7d9c-4d30-9b72-a587ed2801cc for instance 213c2110-983e-47cc-b98c-6b8b91a5e7a3 on hv-cinder-81689 Jan 28 00:58:25.910450 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-9485d17f-f058-4edf-b96a-4c1e3be223bc req-80d91b4e-be2d-469a-ae3f-767ea66d4764 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060758 Jan 28 00:58:25.911977 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 60/103] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:25.920348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:25.922131 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:25.929074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.929749 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.930542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.930995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.931389 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-baac5125-7fe6-468f-9930-fd5b0f431bfe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:25.945789 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-baac5125-7fe6-468f-9930-fd5b0f431bfe tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1501 microversion: 2.1 time: 0.228764 Jan 28 00:58:25.946982 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 44/104] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:25 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:26.129331 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:26.141801 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:26.143820 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:26.145827 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-38f8441e-5167-4b21-8538-38d632ca6ed4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1408 microversion: 2.20 time: 0.231734 Jan 28 00:58:26.146902 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 61/105] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:25 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:26.590936 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-42d0ffe6-b501-4625-9934-f012f104f8af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:26.591458 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-42d0ffe6-b501-4625-9934-f012f104f8af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:26.598094 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-42d0ffe6-b501-4625-9934-f012f104f8af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:26.598553 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-42d0ffe6-b501-4625-9934-f012f104f8af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:26.599386 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-42d0ffe6-b501-4625-9934-f012f104f8af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:26.599823 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-42d0ffe6-b501-4625-9934-f012f104f8af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:26.794936 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-42d0ffe6-b501-4625-9934-f012f104f8af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:26.808022 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-42d0ffe6-b501-4625-9934-f012f104f8af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.220555 Jan 28 00:58:26.809391 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 45/106] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:26 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:27.174965 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:27.177007 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:27.188990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.190219 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.191877 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.192657 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.380609 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:27.389158 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:27.391157 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:27.392334 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6a3f47fd-97cd-4cbe-a82a-370e512de66b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1600 microversion: 2.20 time: 0.225826 Jan 28 00:58:27.392890 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 62/107] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:27 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1600 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:27.411686 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0f6e5e65-314e-4ad6-a1a5-610c58f6fcd9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:27.412419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0f6e5e65-314e-4ad6-a1a5-610c58f6fcd9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:27.423404 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fc1b7405-e0fa-4140-8172-8c8c90b32fa2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "901cc7c4-73da-4376-a16e-dcdb1928f71c"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:27.424801 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fc1b7405-e0fa-4140-8172-8c8c90b32fa2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:27.431314 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f6e5e65-314e-4ad6-a1a5-610c58f6fcd9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.431830 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc1b7405-e0fa-4140-8172-8c8c90b32fa2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.432281 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f6e5e65-314e-4ad6-a1a5-610c58f6fcd9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.432535 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc1b7405-e0fa-4140-8172-8c8c90b32fa2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.433394 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f6e5e65-314e-4ad6-a1a5-610c58f6fcd9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.433512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc1b7405-e0fa-4140-8172-8c8c90b32fa2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.433968 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f6e5e65-314e-4ad6-a1a5-610c58f6fcd9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.434133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc1b7405-e0fa-4140-8172-8c8c90b32fa2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.617588 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0f6e5e65-314e-4ad6-a1a5-610c58f6fcd9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.209532 Jan 28 00:58:27.618176 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 46/108] 10.222.0.78 () {60 vars in 1315 bytes} [Fri Jan 28 00:58:27 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-interface => generated 285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:58:27.826580 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1bddbd1b-3b72-4ffc-b4a6-1f37b8886703 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:27.828219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1bddbd1b-3b72-4ffc-b4a6-1f37b8886703 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:27.834844 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1bddbd1b-3b72-4ffc-b4a6-1f37b8886703 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.835316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1bddbd1b-3b72-4ffc-b4a6-1f37b8886703 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.836312 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1bddbd1b-3b72-4ffc-b4a6-1f37b8886703 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.837094 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1bddbd1b-3b72-4ffc-b4a6-1f37b8886703 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.920500 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fc1b7405-e0fa-4140-8172-8c8c90b32fa2 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "POST /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505567 Jan 28 00:58:27.926158 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 63/109] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 00:58:27 2022] POST /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:58:28.580167 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1bddbd1b-3b72-4ffc-b4a6-1f37b8886703 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:28.596283 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1bddbd1b-3b72-4ffc-b4a6-1f37b8886703 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1322 microversion: 2.1 time: 0.774055 Jan 28 00:58:28.598249 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 47/110] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:27 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1322 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:29.404400 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-f4015410-7735-4a95-8277-ac91d96299fb req-ac3987c3-fc51-4098-ba4e-26745a974724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8ab5025-62f7-40d2-b976-95ed4c6f0499", "tag": "4018b024-2307-4179-b2ef-10369aaee53c"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:29.406007 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ecd7098d-250a-4da7-a1b7-35b46ab3aa9f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:29.408348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ecd7098d-250a-4da7-a1b7-35b46ab3aa9f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:29.409533 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:29.409533 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 00:58:29.421370 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ecd7098d-250a-4da7-a1b7-35b46ab3aa9f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:29.422310 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-f4015410-7735-4a95-8277-ac91d96299fb req-ac3987c3-fc51-4098-ba4e-26745a974724 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:29.423374 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-f4015410-7735-4a95-8277-ac91d96299fb req-ac3987c3-fc51-4098-ba4e-26745a974724 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:29.427178 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ecd7098d-250a-4da7-a1b7-35b46ab3aa9f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:29.428777 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ecd7098d-250a-4da7-a1b7-35b46ab3aa9f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:29.429551 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ecd7098d-250a-4da7-a1b7-35b46ab3aa9f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:29.449361 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-f4015410-7735-4a95-8277-ac91d96299fb req-ac3987c3-fc51-4098-ba4e-26745a974724 service nova] Creating event network-changed:4018b024-2307-4179-b2ef-10369aaee53c for instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 on hv-cinder-81689 Jan 28 00:58:29.465632 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-f4015410-7735-4a95-8277-ac91d96299fb req-ac3987c3-fc51-4098-ba4e-26745a974724 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068171 Jan 28 00:58:29.467286 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 48/111] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:58:29.615370 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ecd7098d-250a-4da7-a1b7-35b46ab3aa9f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 14 microversion: 2.20 time: 0.219797 Jan 28 00:58:29.616931 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 64/112] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:29 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 14 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:29.629576 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d8828325-e010-4c37-b007-8986d4410d66 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:29.630454 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d8828325-e010-4c37-b007-8986d4410d66 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:29.638955 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d8828325-e010-4c37-b007-8986d4410d66 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:29.639555 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d8828325-e010-4c37-b007-8986d4410d66 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:29.640568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d8828325-e010-4c37-b007-8986d4410d66 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:29.641109 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d8828325-e010-4c37-b007-8986d4410d66 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.029734 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d8828325-e010-4c37-b007-8986d4410d66 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:30.048154 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d8828325-e010-4c37-b007-8986d4410d66 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1517 microversion: 2.1 time: 0.433033 Jan 28 00:58:30.049621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 49/113] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:29 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1517 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:30.077018 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a2d27543-ed49-4021-8606-7e70a66c92cf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:30.080458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a2d27543-ed49-4021-8606-7e70a66c92cf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:30.105075 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2d27543-ed49-4021-8606-7e70a66c92cf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:30.106331 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2d27543-ed49-4021-8606-7e70a66c92cf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.110356 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2d27543-ed49-4021-8606-7e70a66c92cf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:30.111001 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2d27543-ed49-4021-8606-7e70a66c92cf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.177375 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-a2d27543-ed49-4021-8606-7e70a66c92cf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'flavor' on Instance uuid 213c2110-983e-47cc-b98c-6b8b91a5e7a3 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:58:30.342417 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a2d27543-ed49-4021-8606-7e70a66c92cf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "POST /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3/action" status: 200 len: 32 microversion: 2.1 time: 0.267240 Jan 28 00:58:30.356879 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 65/114] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:30 2022] POST /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3/action => generated 32 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:30.368800 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-72742e33-9fa1-4e3f-9607-a0e02ceb950a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:30.369379 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-72742e33-9fa1-4e3f-9607-a0e02ceb950a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:30.385429 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-72742e33-9fa1-4e3f-9607-a0e02ceb950a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:30.386505 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-72742e33-9fa1-4e3f-9607-a0e02ceb950a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.387802 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-72742e33-9fa1-4e3f-9607-a0e02ceb950a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:30.388785 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-72742e33-9fa1-4e3f-9607-a0e02ceb950a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.629559 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1be2501c-3322-432f-ad46-9076f076ab09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:30.631991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1be2501c-3322-432f-ad46-9076f076ab09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:30.648244 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1be2501c-3322-432f-ad46-9076f076ab09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:30.648700 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1be2501c-3322-432f-ad46-9076f076ab09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.649517 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1be2501c-3322-432f-ad46-9076f076ab09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:30.649959 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1be2501c-3322-432f-ad46-9076f076ab09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.776611 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1be2501c-3322-432f-ad46-9076f076ab09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 14 microversion: 2.20 time: 0.152197 Jan 28 00:58:30.779821 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 66/115] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:30 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:30.964736 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-72742e33-9fa1-4e3f-9607-a0e02ceb950a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:30.983091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-72742e33-9fa1-4e3f-9607-a0e02ceb950a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.616022 Jan 28 00:58:30.986868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 50/116] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:30 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:31.796111 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f2480ef4-a531-42e8-ae10-29a5a28075d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:31.798316 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f2480ef4-a531-42e8-ae10-29a5a28075d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:31.815298 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f2480ef4-a531-42e8-ae10-29a5a28075d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:31.817764 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f2480ef4-a531-42e8-ae10-29a5a28075d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:31.822440 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f2480ef4-a531-42e8-ae10-29a5a28075d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:31.823377 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f2480ef4-a531-42e8-ae10-29a5a28075d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:31.953366 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f2480ef4-a531-42e8-ae10-29a5a28075d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 14 microversion: 2.20 time: 0.167125 Jan 28 00:58:31.954915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 67/117] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:31 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:32.005011 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-dc241c9c-fa9a-4a1a-a608-a25e5ee222c0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:32.006643 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-dc241c9c-fa9a-4a1a-a608-a25e5ee222c0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:32.019953 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dc241c9c-fa9a-4a1a-a608-a25e5ee222c0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:32.020912 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dc241c9c-fa9a-4a1a-a608-a25e5ee222c0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:32.021887 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dc241c9c-fa9a-4a1a-a608-a25e5ee222c0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:32.022518 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dc241c9c-fa9a-4a1a-a608-a25e5ee222c0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:32.221386 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-dc241c9c-fa9a-4a1a-a608-a25e5ee222c0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:32.235025 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-dc241c9c-fa9a-4a1a-a608-a25e5ee222c0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.234396 Jan 28 00:58:32.235630 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 51/118] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:31 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:32.966681 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c8c5b354-8959-41b4-b193-472bb1ac3ec1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:32.967740 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c8c5b354-8959-41b4-b193-472bb1ac3ec1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:32.977218 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c8c5b354-8959-41b4-b193-472bb1ac3ec1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:32.977911 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c8c5b354-8959-41b4-b193-472bb1ac3ec1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:32.978870 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c8c5b354-8959-41b4-b193-472bb1ac3ec1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:32.979565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c8c5b354-8959-41b4-b193-472bb1ac3ec1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:33.256445 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2e3795fc-7924-4699-987e-0da4e2b72817 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:33.257240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2e3795fc-7924-4699-987e-0da4e2b72817 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:33.264560 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e3795fc-7924-4699-987e-0da4e2b72817 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:33.265146 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e3795fc-7924-4699-987e-0da4e2b72817 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:33.266391 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e3795fc-7924-4699-987e-0da4e2b72817 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:33.267091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e3795fc-7924-4699-987e-0da4e2b72817 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:33.474365 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2e3795fc-7924-4699-987e-0da4e2b72817 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:33.482387 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2e3795fc-7924-4699-987e-0da4e2b72817 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.230537 Jan 28 00:58:33.493319 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 52/119] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:33 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:34.501559 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a00334e9-a488-46cd-aed7-b7be4ca068d8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:34.503044 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a00334e9-a488-46cd-aed7-b7be4ca068d8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:34.509471 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a00334e9-a488-46cd-aed7-b7be4ca068d8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:34.509995 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a00334e9-a488-46cd-aed7-b7be4ca068d8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:34.511056 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a00334e9-a488-46cd-aed7-b7be4ca068d8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:34.511565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a00334e9-a488-46cd-aed7-b7be4ca068d8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:34.727598 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a00334e9-a488-46cd-aed7-b7be4ca068d8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:34.742341 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a00334e9-a488-46cd-aed7-b7be4ca068d8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.245304 Jan 28 00:58:34.743649 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 53/120] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:34 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:35.635080 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c8c5b354-8959-41b4-b193-472bb1ac3ec1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 14 microversion: 2.20 time: 2.671341 Jan 28 00:58:35.636958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 68/121] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:32 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 14 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:35.762132 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b17e7e80-4b67-4020-8ddd-51bc3637fcff tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:35.762937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b17e7e80-4b67-4020-8ddd-51bc3637fcff tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:35.771546 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b17e7e80-4b67-4020-8ddd-51bc3637fcff tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:35.772281 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b17e7e80-4b67-4020-8ddd-51bc3637fcff tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:35.773148 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b17e7e80-4b67-4020-8ddd-51bc3637fcff tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:35.773894 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b17e7e80-4b67-4020-8ddd-51bc3637fcff tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:35.975168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b17e7e80-4b67-4020-8ddd-51bc3637fcff tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:35.987223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b17e7e80-4b67-4020-8ddd-51bc3637fcff tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.229333 Jan 28 00:58:35.988237 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 54/122] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:35 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:36.650317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e95e9b85-42b4-4fe3-bf62-77b14c35aabc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:36.651422 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e95e9b85-42b4-4fe3-bf62-77b14c35aabc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:36.660131 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e95e9b85-42b4-4fe3-bf62-77b14c35aabc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:36.660649 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e95e9b85-42b4-4fe3-bf62-77b14c35aabc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:36.661456 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e95e9b85-42b4-4fe3-bf62-77b14c35aabc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:36.661897 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e95e9b85-42b4-4fe3-bf62-77b14c35aabc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:37.011807 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ec1e3338-f153-4a4e-a4f6-9c865e881e56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:37.012678 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ec1e3338-f153-4a4e-a4f6-9c865e881e56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:37.019939 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ec1e3338-f153-4a4e-a4f6-9c865e881e56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:37.021466 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ec1e3338-f153-4a4e-a4f6-9c865e881e56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:37.023463 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ec1e3338-f153-4a4e-a4f6-9c865e881e56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:37.024560 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ec1e3338-f153-4a4e-a4f6-9c865e881e56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:37.183846 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ec1e3338-f153-4a4e-a4f6-9c865e881e56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:37.202240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ec1e3338-f153-4a4e-a4f6-9c865e881e56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.193376 Jan 28 00:58:37.204551 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 55/123] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:37 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:38.226506 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cd593e8d-725e-4423-ba0a-7fcb26ce3866 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:38.227225 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cd593e8d-725e-4423-ba0a-7fcb26ce3866 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:38.233293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cd593e8d-725e-4423-ba0a-7fcb26ce3866 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:38.233919 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cd593e8d-725e-4423-ba0a-7fcb26ce3866 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:38.234917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cd593e8d-725e-4423-ba0a-7fcb26ce3866 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:38.235410 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cd593e8d-725e-4423-ba0a-7fcb26ce3866 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:38.406711 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-cd593e8d-725e-4423-ba0a-7fcb26ce3866 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:38.414661 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cd593e8d-725e-4423-ba0a-7fcb26ce3866 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.191748 Jan 28 00:58:38.415275 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 56/124] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:38 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:39.434667 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-143aa3b1-64fc-4bf1-ab97-3cdcd575c9ce tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:39.435451 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-143aa3b1-64fc-4bf1-ab97-3cdcd575c9ce tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:39.441765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-143aa3b1-64fc-4bf1-ab97-3cdcd575c9ce tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:39.442215 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-143aa3b1-64fc-4bf1-ab97-3cdcd575c9ce tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:39.443042 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-143aa3b1-64fc-4bf1-ab97-3cdcd575c9ce tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:39.443478 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-143aa3b1-64fc-4bf1-ab97-3cdcd575c9ce tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:39.456476 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e95e9b85-42b4-4fe3-bf62-77b14c35aabc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 14 microversion: 2.20 time: 2.810322 Jan 28 00:58:39.460498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 69/125] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:36 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 14 bytes in 2812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:39.609102 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-143aa3b1-64fc-4bf1-ab97-3cdcd575c9ce tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:39.621063 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-143aa3b1-64fc-4bf1-ab97-3cdcd575c9ce tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.190161 Jan 28 00:58:39.622961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 57/126] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:39 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:40.468625 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-47404793-ae30-47f5-87c3-f6d4e9608244 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:40.469647 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-47404793-ae30-47f5-87c3-f6d4e9608244 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:40.477323 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47404793-ae30-47f5-87c3-f6d4e9608244 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:40.477783 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47404793-ae30-47f5-87c3-f6d4e9608244 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:40.479122 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47404793-ae30-47f5-87c3-f6d4e9608244 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:40.479573 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47404793-ae30-47f5-87c3-f6d4e9608244 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:40.637356 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-47404793-ae30-47f5-87c3-f6d4e9608244 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 14 microversion: 2.20 time: 0.173151 Jan 28 00:58:40.637992 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 70/127] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:40 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:40.650077 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7dd327e1-fb15-4d16-ba7c-1a15e911da15 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:40.651267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7dd327e1-fb15-4d16-ba7c-1a15e911da15 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:40.657766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7dd327e1-fb15-4d16-ba7c-1a15e911da15 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:40.658427 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7dd327e1-fb15-4d16-ba7c-1a15e911da15 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:40.659471 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7dd327e1-fb15-4d16-ba7c-1a15e911da15 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:40.659931 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7dd327e1-fb15-4d16-ba7c-1a15e911da15 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:40.814018 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7dd327e1-fb15-4d16-ba7c-1a15e911da15 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:40.821665 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7dd327e1-fb15-4d16-ba7c-1a15e911da15 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.175851 Jan 28 00:58:40.822235 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 58/128] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:40 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:41.649880 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6cc97c90-f3ad-4ddc-98b3-46c527d2a5a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:41.650907 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6cc97c90-f3ad-4ddc-98b3-46c527d2a5a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:41.659886 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6cc97c90-f3ad-4ddc-98b3-46c527d2a5a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:41.660581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6cc97c90-f3ad-4ddc-98b3-46c527d2a5a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:41.661416 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6cc97c90-f3ad-4ddc-98b3-46c527d2a5a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:41.662014 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6cc97c90-f3ad-4ddc-98b3-46c527d2a5a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:41.793398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6cc97c90-f3ad-4ddc-98b3-46c527d2a5a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 14 microversion: 2.20 time: 0.147360 Jan 28 00:58:41.794059 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 71/129] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:41 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:41.842618 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4f7b5c31-88aa-4332-a0a0-ae8ffbe810a6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:41.844431 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4f7b5c31-88aa-4332-a0a0-ae8ffbe810a6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:41.852999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f7b5c31-88aa-4332-a0a0-ae8ffbe810a6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:41.853536 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f7b5c31-88aa-4332-a0a0-ae8ffbe810a6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:41.854573 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f7b5c31-88aa-4332-a0a0-ae8ffbe810a6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:41.855349 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f7b5c31-88aa-4332-a0a0-ae8ffbe810a6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.044017 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4f7b5c31-88aa-4332-a0a0-ae8ffbe810a6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:42.079751 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4f7b5c31-88aa-4332-a0a0-ae8ffbe810a6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.242892 Jan 28 00:58:42.080863 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 59/130] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:41 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:42.336525 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fae05df8-4ff8-4944-85db-acb0d721215a tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:42.337177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fae05df8-4ff8-4944-85db-acb0d721215a tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:42.345137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fae05df8-4ff8-4944-85db-acb0d721215a tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.345584 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fae05df8-4ff8-4944-85db-acb0d721215a tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.346435 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fae05df8-4ff8-4944-85db-acb0d721215a tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.346942 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fae05df8-4ff8-4944-85db-acb0d721215a tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.397163 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fae05df8-4ff8-4944-85db-acb0d721215a tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Going to try to terminate instance {{(pid=116254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:58:42.524789 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fae05df8-4ff8-4944-85db-acb0d721215a tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "DELETE /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 204 len: 0 microversion: 2.1 time: 0.191910 Jan 28 00:58:42.525384 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 72/131] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 00:58:42 2022] DELETE /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:58:42.536252 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bd4f4255-3fbb-420b-aa81-d924f92c6c1c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:42.537146 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-bd4f4255-3fbb-420b-aa81-d924f92c6c1c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:42.544495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bd4f4255-3fbb-420b-aa81-d924f92c6c1c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.545404 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bd4f4255-3fbb-420b-aa81-d924f92c6c1c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.546458 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bd4f4255-3fbb-420b-aa81-d924f92c6c1c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.546932 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bd4f4255-3fbb-420b-aa81-d924f92c6c1c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.740034 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-bd4f4255-3fbb-420b-aa81-d924f92c6c1c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:42.759615 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bd4f4255-3fbb-420b-aa81-d924f92c6c1c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1553 microversion: 2.1 time: 0.227108 Jan 28 00:58:42.760494 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 60/132] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:42 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:42.807804 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f5a75eec-bc84-4611-828b-35d8d85828e8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:42.808881 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f5a75eec-bc84-4611-828b-35d8d85828e8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:42.817993 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5a75eec-bc84-4611-828b-35d8d85828e8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.818542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5a75eec-bc84-4611-828b-35d8d85828e8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.819434 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5a75eec-bc84-4611-828b-35d8d85828e8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.819940 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5a75eec-bc84-4611-828b-35d8d85828e8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.941028 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f5a75eec-bc84-4611-828b-35d8d85828e8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 14 microversion: 2.20 time: 0.138085 Jan 28 00:58:42.941787 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 73/133] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:42 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:43.097405 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5f04d7fc-f5d2-4aac-9921-003297393a31 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:43.098086 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5f04d7fc-f5d2-4aac-9921-003297393a31 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:43.104060 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f04d7fc-f5d2-4aac-9921-003297393a31 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:43.104509 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f04d7fc-f5d2-4aac-9921-003297393a31 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:43.105312 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f04d7fc-f5d2-4aac-9921-003297393a31 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:43.105735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f04d7fc-f5d2-4aac-9921-003297393a31 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:43.243613 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5f04d7fc-f5d2-4aac-9921-003297393a31 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:43.255421 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5f04d7fc-f5d2-4aac-9921-003297393a31 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.161655 Jan 28 00:58:43.256037 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 61/134] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:43 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:43.780169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fb63ee92-34a0-4f38-a99a-da702b5c7870 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:43.780902 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fb63ee92-34a0-4f38-a99a-da702b5c7870 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:43.791650 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fb63ee92-34a0-4f38-a99a-da702b5c7870 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:43.792431 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fb63ee92-34a0-4f38-a99a-da702b5c7870 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:43.793961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fb63ee92-34a0-4f38-a99a-da702b5c7870 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:43.795008 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fb63ee92-34a0-4f38-a99a-da702b5c7870 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:43.954025 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-87ca02c5-b4f2-4fd1-ac27-f11a267594d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:43.955623 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-87ca02c5-b4f2-4fd1-ac27-f11a267594d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:43.965504 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-87ca02c5-b4f2-4fd1-ac27-f11a267594d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:43.966401 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-87ca02c5-b4f2-4fd1-ac27-f11a267594d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:43.967950 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-87ca02c5-b4f2-4fd1-ac27-f11a267594d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:43.968485 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-87ca02c5-b4f2-4fd1-ac27-f11a267594d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:44.144023 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-87ca02c5-b4f2-4fd1-ac27-f11a267594d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 14 microversion: 2.20 time: 0.195839 Jan 28 00:58:44.145406 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 62/135] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:43 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:44.163074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fb63ee92-34a0-4f38-a99a-da702b5c7870 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:44.177324 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fb63ee92-34a0-4f38-a99a-da702b5c7870 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1553 microversion: 2.1 time: 0.402781 Jan 28 00:58:44.178308 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 74/136] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:43 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1553 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:44.273456 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6e56b1ef-c0b7-4e1f-b67e-bf4a1719eb84 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:44.274295 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6e56b1ef-c0b7-4e1f-b67e-bf4a1719eb84 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:44.281842 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6e56b1ef-c0b7-4e1f-b67e-bf4a1719eb84 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:44.282435 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6e56b1ef-c0b7-4e1f-b67e-bf4a1719eb84 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:44.283266 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6e56b1ef-c0b7-4e1f-b67e-bf4a1719eb84 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:44.283784 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6e56b1ef-c0b7-4e1f-b67e-bf4a1719eb84 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:44.449736 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6e56b1ef-c0b7-4e1f-b67e-bf4a1719eb84 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:44.459665 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6e56b1ef-c0b7-4e1f-b67e-bf4a1719eb84 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.190500 Jan 28 00:58:44.460395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 63/137] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:44 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:45.157418 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3cf76318-f1af-479c-afb0-dbc0f0a7f0cd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:45.159087 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3cf76318-f1af-479c-afb0-dbc0f0a7f0cd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:45.169361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3cf76318-f1af-479c-afb0-dbc0f0a7f0cd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.171249 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3cf76318-f1af-479c-afb0-dbc0f0a7f0cd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.172472 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3cf76318-f1af-479c-afb0-dbc0f0a7f0cd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.173280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3cf76318-f1af-479c-afb0-dbc0f0a7f0cd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.195243 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bdf21714-eaec-4312-adc9-4c569f52756c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:45.196001 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-bdf21714-eaec-4312-adc9-4c569f52756c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:45.207493 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bdf21714-eaec-4312-adc9-4c569f52756c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.208279 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bdf21714-eaec-4312-adc9-4c569f52756c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.209380 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bdf21714-eaec-4312-adc9-4c569f52756c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.210028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bdf21714-eaec-4312-adc9-4c569f52756c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.447870 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3cf76318-f1af-479c-afb0-dbc0f0a7f0cd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 6018 microversion: 2.20 time: 0.295026 Jan 28 00:58:45.448604 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 75/138] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:45 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 6018 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:45.477706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b688ce13-8dd1-49d3-a41a-9ee50ea35487 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:45.478505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b688ce13-8dd1-49d3-a41a-9ee50ea35487 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:45.497404 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b688ce13-8dd1-49d3-a41a-9ee50ea35487 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.503513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b688ce13-8dd1-49d3-a41a-9ee50ea35487 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.504730 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b688ce13-8dd1-49d3-a41a-9ee50ea35487 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.505804 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b688ce13-8dd1-49d3-a41a-9ee50ea35487 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.586787 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-bdf21714-eaec-4312-adc9-4c569f52756c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:45.597476 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bdf21714-eaec-4312-adc9-4c569f52756c tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1553 microversion: 2.1 time: 0.405857 Jan 28 00:58:45.598065 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 64/139] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:45 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:45.873347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b688ce13-8dd1-49d3-a41a-9ee50ea35487 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:45.895398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b688ce13-8dd1-49d3-a41a-9ee50ea35487 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.418447 Jan 28 00:58:45.897462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 76/140] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:45 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:46.462169 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7c1f3cdb-a320-44e9-b40f-33f19676655d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:46.463751 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7c1f3cdb-a320-44e9-b40f-33f19676655d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:46.471568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c1f3cdb-a320-44e9-b40f-33f19676655d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.472439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c1f3cdb-a320-44e9-b40f-33f19676655d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.475060 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c1f3cdb-a320-44e9-b40f-33f19676655d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.475693 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c1f3cdb-a320-44e9-b40f-33f19676655d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.516067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-577802e9-a74c-458b-ae09-ad79200cb0bb req-0b9b3524-c45b-46a7-b701-3fdf32747de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67efe239-0022-4298-878f-42dd83b61165", "name": "network-vif-deleted", "tag": "777d0cea-b600-4411-a443-06993344e637"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:46.520720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:46.520720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 00:58:46.537126 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-577802e9-a74c-458b-ae09-ad79200cb0bb req-0b9b3524-c45b-46a7-b701-3fdf32747de0 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.537572 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-577802e9-a74c-458b-ae09-ad79200cb0bb req-0b9b3524-c45b-46a7-b701-3fdf32747de0 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.569373 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-577802e9-a74c-458b-ae09-ad79200cb0bb req-0b9b3524-c45b-46a7-b701-3fdf32747de0 service nova] Creating event network-vif-deleted:777d0cea-b600-4411-a443-06993344e637 for instance 67efe239-0022-4298-878f-42dd83b61165 on hv-cinder-81689 Jan 28 00:58:46.579553 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-577802e9-a74c-458b-ae09-ad79200cb0bb req-0b9b3524-c45b-46a7-b701-3fdf32747de0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072844 Jan 28 00:58:46.581222 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 77/141] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:58:46.623741 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7c1f3cdb-a320-44e9-b40f-33f19676655d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 10658 microversion: 2.20 time: 0.166694 Jan 28 00:58:46.629679 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 65/142] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:46 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 10658 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:46.635855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ad84aea2-049c-4aa4-abfb-23e2de1e15c3 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:46.637834 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ad84aea2-049c-4aa4-abfb-23e2de1e15c3 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:46.652133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ad84aea2-049c-4aa4-abfb-23e2de1e15c3 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.652985 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ad84aea2-049c-4aa4-abfb-23e2de1e15c3 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.655092 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ad84aea2-049c-4aa4-abfb-23e2de1e15c3 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.655973 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ad84aea2-049c-4aa4-abfb-23e2de1e15c3 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.760579 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ad84aea2-049c-4aa4-abfb-23e2de1e15c3 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:46.772406 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ad84aea2-049c-4aa4-abfb-23e2de1e15c3 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1346 microversion: 2.1 time: 0.152908 Jan 28 00:58:46.779208 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 78/143] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:46 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1346 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:46.916177 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9d235f71-b73e-435d-a855-ee19f99e1179 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:46.916988 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9d235f71-b73e-435d-a855-ee19f99e1179 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:46.924474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d235f71-b73e-435d-a855-ee19f99e1179 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.925550 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d235f71-b73e-435d-a855-ee19f99e1179 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.926971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d235f71-b73e-435d-a855-ee19f99e1179 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.926971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d235f71-b73e-435d-a855-ee19f99e1179 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:47.111919 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-9d235f71-b73e-435d-a855-ee19f99e1179 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:47.125298 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9d235f71-b73e-435d-a855-ee19f99e1179 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.215111 Jan 28 00:58:47.126436 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 66/144] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:46 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:47.643067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bc1f43eb-71e0-41bf-b441-02b60af6bda4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:47.644662 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bc1f43eb-71e0-41bf-b441-02b60af6bda4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:47.656672 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bc1f43eb-71e0-41bf-b441-02b60af6bda4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:47.657589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bc1f43eb-71e0-41bf-b441-02b60af6bda4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:47.659076 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bc1f43eb-71e0-41bf-b441-02b60af6bda4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:47.659834 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bc1f43eb-71e0-41bf-b441-02b60af6bda4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:47.781640 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-bc1f43eb-71e0-41bf-b441-02b60af6bda4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 15064 microversion: 2.20 time: 0.147028 Jan 28 00:58:47.782771 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 79/145] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:47 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 15064 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:47.811786 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:47.813248 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:47.821225 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:47.821684 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:47.822487 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:47.823218 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:47.883820 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:47.883820 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:47.883820 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lazy-loading 'fault' on Instance uuid 67efe239-0022-4298-878f-42dd83b61165 {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:58:47.937777 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43a28c98280c498c983c230a672a6601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c28f76a4d78416dabc595b2d237134d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:47.947468 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ddadc9b9-c39c-48b6-b2c2-00574919e469 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 200 len: 1351 microversion: 2.1 time: 0.146566 Jan 28 00:58:47.955220 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 67/146] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:47 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 1351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:48.144266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e62db1c7-383c-4579-bf6e-4b8f24f05740 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:48.144883 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e62db1c7-383c-4579-bf6e-4b8f24f05740 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:48.152135 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e62db1c7-383c-4579-bf6e-4b8f24f05740 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:48.152589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e62db1c7-383c-4579-bf6e-4b8f24f05740 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:48.153385 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e62db1c7-383c-4579-bf6e-4b8f24f05740 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:48.153828 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e62db1c7-383c-4579-bf6e-4b8f24f05740 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:48.289528 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e62db1c7-383c-4579-bf6e-4b8f24f05740 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:48.297917 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e62db1c7-383c-4579-bf6e-4b8f24f05740 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.157644 Jan 28 00:58:48.298474 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 80/147] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:48 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:48.795942 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-87767a58-a27e-45f8-9768-58fb0d382fe7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:48.797476 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-87767a58-a27e-45f8-9768-58fb0d382fe7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:48.807302 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-87767a58-a27e-45f8-9768-58fb0d382fe7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:48.808083 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-87767a58-a27e-45f8-9768-58fb0d382fe7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:48.809646 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-87767a58-a27e-45f8-9768-58fb0d382fe7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:48.810621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-87767a58-a27e-45f8-9768-58fb0d382fe7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:48.973701 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-87767a58-a27e-45f8-9768-58fb0d382fe7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 17498 microversion: 2.20 time: 0.182783 Jan 28 00:58:48.978009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 68/148] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:48 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 17498 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:48.978139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-80048f51-8788-488a-821b-79ac0aacc958 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:48.978139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-80048f51-8788-488a-821b-79ac0aacc958 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:48.983929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-80048f51-8788-488a-821b-79ac0aacc958 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:48.984305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-80048f51-8788-488a-821b-79ac0aacc958 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:48.985556 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-80048f51-8788-488a-821b-79ac0aacc958 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:48.986156 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-80048f51-8788-488a-821b-79ac0aacc958 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:49.003390 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-80048f51-8788-488a-821b-79ac0aacc958 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] HTTP exception thrown: Instance 67efe239-0022-4298-878f-42dd83b61165 could not be found. Jan 28 00:58:49.004137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-80048f51-8788-488a-821b-79ac0aacc958 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Returning 404 to user: Instance 67efe239-0022-4298-878f-42dd83b61165 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:58:49.005141 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-80048f51-8788-488a-821b-79ac0aacc958 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 404 len: 111 microversion: 2.1 time: 0.041916 Jan 28 00:58:49.005971 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 81/149] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:48 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:58:49.156882 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f9b241b7-ff32-455f-b4af-018951b845ce tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:49.158005 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f9b241b7-ff32-455f-b4af-018951b845ce tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:49.165393 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f9b241b7-ff32-455f-b4af-018951b845ce tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:49.165839 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f9b241b7-ff32-455f-b4af-018951b845ce tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:49.166615 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f9b241b7-ff32-455f-b4af-018951b845ce tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:49.167076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f9b241b7-ff32-455f-b4af-018951b845ce tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:49.184019 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-f9b241b7-ff32-455f-b4af-018951b845ce tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] HTTP exception thrown: Instance 67efe239-0022-4298-878f-42dd83b61165 could not be found. Jan 28 00:58:49.184826 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f9b241b7-ff32-455f-b4af-018951b845ce tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Returning 404 to user: Instance 67efe239-0022-4298-878f-42dd83b61165 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:58:49.186013 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f9b241b7-ff32-455f-b4af-018951b845ce tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033439 Jan 28 00:58:49.187498 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 69/150] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 00:58:49 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:58:49.324949 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bbbea3e6-df76-4929-8e7e-941bc7b39723 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:49.326386 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bbbea3e6-df76-4929-8e7e-941bc7b39723 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:49.339268 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bbbea3e6-df76-4929-8e7e-941bc7b39723 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:49.339998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bbbea3e6-df76-4929-8e7e-941bc7b39723 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:49.341326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bbbea3e6-df76-4929-8e7e-941bc7b39723 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:49.342047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bbbea3e6-df76-4929-8e7e-941bc7b39723 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:49.481397 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-bbbea3e6-df76-4929-8e7e-941bc7b39723 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:49.489044 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-bbbea3e6-df76-4929-8e7e-941bc7b39723 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.170233 Jan 28 00:58:49.489722 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 82/151] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:49 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:49.984906 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-015e3290-0931-49a2-9585-c85e9d589db5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:49.985850 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-015e3290-0931-49a2-9585-c85e9d589db5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:49.992205 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-015e3290-0931-49a2-9585-c85e9d589db5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:49.992651 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-015e3290-0931-49a2-9585-c85e9d589db5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:49.993431 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-015e3290-0931-49a2-9585-c85e9d589db5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:49.993862 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-015e3290-0931-49a2-9585-c85e9d589db5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:50.505726 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3e3bf939-4689-4ca1-a17a-17d5b43100e6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:50.507011 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3e3bf939-4689-4ca1-a17a-17d5b43100e6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:50.513684 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e3bf939-4689-4ca1-a17a-17d5b43100e6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:50.514372 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e3bf939-4689-4ca1-a17a-17d5b43100e6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:50.515257 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e3bf939-4689-4ca1-a17a-17d5b43100e6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:50.516074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e3bf939-4689-4ca1-a17a-17d5b43100e6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:50.672342 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3e3bf939-4689-4ca1-a17a-17d5b43100e6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:50.681290 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3e3bf939-4689-4ca1-a17a-17d5b43100e6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.179058 Jan 28 00:58:50.691531 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 83/152] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:50 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:51.702082 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-723b35bf-c3e4-4e6a-9055-a34676c5d156 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:51.703592 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-723b35bf-c3e4-4e6a-9055-a34676c5d156 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:51.727917 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-723b35bf-c3e4-4e6a-9055-a34676c5d156 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:51.728668 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-723b35bf-c3e4-4e6a-9055-a34676c5d156 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:51.729546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-723b35bf-c3e4-4e6a-9055-a34676c5d156 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:51.730003 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-723b35bf-c3e4-4e6a-9055-a34676c5d156 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:51.957198 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-723b35bf-c3e4-4e6a-9055-a34676c5d156 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:51.969957 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-723b35bf-c3e4-4e6a-9055-a34676c5d156 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.271986 Jan 28 00:58:51.981223 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 84/153] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:51 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:52.135169 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-015e3290-0931-49a2-9585-c85e9d589db5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 21519 microversion: 2.20 time: 2.153356 Jan 28 00:58:52.136904 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 70/154] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:49 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 21519 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:52.992803 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-386b2b8e-3c5b-4a4f-a4fc-8a79190b400b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:52.994413 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-386b2b8e-3c5b-4a4f-a4fc-8a79190b400b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:53.004757 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-386b2b8e-3c5b-4a4f-a4fc-8a79190b400b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:53.005972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-386b2b8e-3c5b-4a4f-a4fc-8a79190b400b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:53.007496 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-386b2b8e-3c5b-4a4f-a4fc-8a79190b400b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:53.008182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-386b2b8e-3c5b-4a4f-a4fc-8a79190b400b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:53.153668 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-257add69-ad2c-437c-86ed-57c97a2a5188 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:53.154832 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-257add69-ad2c-437c-86ed-57c97a2a5188 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:53.172571 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-257add69-ad2c-437c-86ed-57c97a2a5188 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:53.173197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-257add69-ad2c-437c-86ed-57c97a2a5188 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:53.175069 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-257add69-ad2c-437c-86ed-57c97a2a5188 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:53.176045 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-257add69-ad2c-437c-86ed-57c97a2a5188 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:53.238239 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-386b2b8e-3c5b-4a4f-a4fc-8a79190b400b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:53.246481 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-386b2b8e-3c5b-4a4f-a4fc-8a79190b400b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.257572 Jan 28 00:58:53.247342 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 85/155] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:52 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:54.264360 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ddc6c666-2e77-4134-9fe7-d06a3a93113f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:54.265276 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ddc6c666-2e77-4134-9fe7-d06a3a93113f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:54.274169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ddc6c666-2e77-4134-9fe7-d06a3a93113f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.274693 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ddc6c666-2e77-4134-9fe7-d06a3a93113f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.275600 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ddc6c666-2e77-4134-9fe7-d06a3a93113f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.276089 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ddc6c666-2e77-4134-9fe7-d06a3a93113f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.461615 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ddc6c666-2e77-4134-9fe7-d06a3a93113f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:54.473740 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ddc6c666-2e77-4134-9fe7-d06a3a93113f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.212897 Jan 28 00:58:54.474484 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 86/156] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:54 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:55.256409 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-257add69-ad2c-437c-86ed-57c97a2a5188 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 24793 microversion: 2.20 time: 2.107292 Jan 28 00:58:55.257049 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 71/157] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:53 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 24793 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:58:55.491612 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d30d47a9-1829-438b-bd0a-7a16452dee13 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:55.492246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d30d47a9-1829-438b-bd0a-7a16452dee13 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:55.499299 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d30d47a9-1829-438b-bd0a-7a16452dee13 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:55.499782 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d30d47a9-1829-438b-bd0a-7a16452dee13 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:55.500577 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d30d47a9-1829-438b-bd0a-7a16452dee13 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:55.501016 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d30d47a9-1829-438b-bd0a-7a16452dee13 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:55.642090 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d30d47a9-1829-438b-bd0a-7a16452dee13 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:55.650248 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d30d47a9-1829-438b-bd0a-7a16452dee13 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.162300 Jan 28 00:58:55.650909 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 87/158] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:55 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:56.269344 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-870cecea-4fa5-42a8-89eb-c598312bd62e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:56.270568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-870cecea-4fa5-42a8-89eb-c598312bd62e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:56.281018 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-870cecea-4fa5-42a8-89eb-c598312bd62e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:56.281460 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-870cecea-4fa5-42a8-89eb-c598312bd62e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:56.282223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-870cecea-4fa5-42a8-89eb-c598312bd62e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:56.282660 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-870cecea-4fa5-42a8-89eb-c598312bd62e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:56.667977 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8bf4a19e-bb32-44d9-89c5-fb1d126b4a0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:56.670178 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8bf4a19e-bb32-44d9-89c5-fb1d126b4a0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:56.680706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8bf4a19e-bb32-44d9-89c5-fb1d126b4a0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:56.681137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8bf4a19e-bb32-44d9-89c5-fb1d126b4a0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:56.682106 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8bf4a19e-bb32-44d9-89c5-fb1d126b4a0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:56.682942 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8bf4a19e-bb32-44d9-89c5-fb1d126b4a0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:56.817249 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8bf4a19e-bb32-44d9-89c5-fb1d126b4a0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:56.825196 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8bf4a19e-bb32-44d9-89c5-fb1d126b4a0a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.160560 Jan 28 00:58:56.825773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 88/159] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:56 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:57.843306 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-92e0b1aa-1e49-40c4-a4cf-a3b21b95cd1d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:57.843988 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-92e0b1aa-1e49-40c4-a4cf-a3b21b95cd1d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:57.850434 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-92e0b1aa-1e49-40c4-a4cf-a3b21b95cd1d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:57.850910 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-92e0b1aa-1e49-40c4-a4cf-a3b21b95cd1d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:57.851723 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-92e0b1aa-1e49-40c4-a4cf-a3b21b95cd1d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:57.852162 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-92e0b1aa-1e49-40c4-a4cf-a3b21b95cd1d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:57.984465 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-92e0b1aa-1e49-40c4-a4cf-a3b21b95cd1d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:57.992011 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-92e0b1aa-1e49-40c4-a4cf-a3b21b95cd1d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.153366 Jan 28 00:58:57.992731 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 89/160] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:57 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:59.009574 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-30d7472e-8774-43b8-b918-c75918de0e3b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:59.010195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-30d7472e-8774-43b8-b918-c75918de0e3b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:59.016540 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30d7472e-8774-43b8-b918-c75918de0e3b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:59.016990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30d7472e-8774-43b8-b918-c75918de0e3b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:59.017779 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30d7472e-8774-43b8-b918-c75918de0e3b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:59.018221 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30d7472e-8774-43b8-b918-c75918de0e3b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:59.122438 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-870cecea-4fa5-42a8-89eb-c598312bd62e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 27040 microversion: 2.20 time: 2.857077 Jan 28 00:58:59.126405 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 72/161] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:56 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 27040 bytes in 2860 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:59.160692 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-30d7472e-8774-43b8-b918-c75918de0e3b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:59.168252 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-30d7472e-8774-43b8-b918-c75918de0e3b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.162273 Jan 28 00:58:59.168847 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 90/162] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:59 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:00.148275 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-46b2a63b-f4d1-4351-a0d3-ac653772c0bf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:00.152024 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-46b2a63b-f4d1-4351-a0d3-ac653772c0bf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:00.167361 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-46b2a63b-f4d1-4351-a0d3-ac653772c0bf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:00.167811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-46b2a63b-f4d1-4351-a0d3-ac653772c0bf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:00.168644 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-46b2a63b-f4d1-4351-a0d3-ac653772c0bf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:00.169087 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-46b2a63b-f4d1-4351-a0d3-ac653772c0bf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:00.189265 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-25a826fc-b6f1-4ed7-9578-5dfbcfbdc141 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:00.190018 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-25a826fc-b6f1-4ed7-9578-5dfbcfbdc141 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:00.197478 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-25a826fc-b6f1-4ed7-9578-5dfbcfbdc141 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:00.198090 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-25a826fc-b6f1-4ed7-9578-5dfbcfbdc141 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:00.198999 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-25a826fc-b6f1-4ed7-9578-5dfbcfbdc141 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:00.199541 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-25a826fc-b6f1-4ed7-9578-5dfbcfbdc141 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:00.314561 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-46b2a63b-f4d1-4351-a0d3-ac653772c0bf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 27526 microversion: 2.20 time: 0.176489 Jan 28 00:59:00.315997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 73/163] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:00 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 27526 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:00.384911 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-25a826fc-b6f1-4ed7-9578-5dfbcfbdc141 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:00.410606 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-25a826fc-b6f1-4ed7-9578-5dfbcfbdc141 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.227009 Jan 28 00:59:00.411589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 91/164] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:00 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:00.964902 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-510d2a2f-265c-425b-9bfb-85ff2d9aad9e tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:00.965503 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-510d2a2f-265c-425b-9bfb-85ff2d9aad9e tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:00.973446 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-510d2a2f-265c-425b-9bfb-85ff2d9aad9e tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:00.973896 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-510d2a2f-265c-425b-9bfb-85ff2d9aad9e tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:00.974696 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-510d2a2f-265c-425b-9bfb-85ff2d9aad9e tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:00.975167 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-510d2a2f-265c-425b-9bfb-85ff2d9aad9e tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:00.991268 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-510d2a2f-265c-425b-9bfb-85ff2d9aad9e tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] HTTP exception thrown: Instance 67efe239-0022-4298-878f-42dd83b61165 could not be found. Jan 28 00:59:00.991883 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-510d2a2f-265c-425b-9bfb-85ff2d9aad9e tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Returning 404 to user: Instance 67efe239-0022-4298-878f-42dd83b61165 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:00.992721 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-510d2a2f-265c-425b-9bfb-85ff2d9aad9e tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "DELETE /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 404 len: 111 microversion: 2.1 time: 0.031868 Jan 28 00:59:00.993282 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 74/165] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 00:59:00 2022] DELETE /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:59:01.006613 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-185b6998-20e1-4bfd-9af2-cd085e178135 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:01.007461 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-185b6998-20e1-4bfd-9af2-cd085e178135 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] [instance: 67efe239-0022-4298-878f-42dd83b61165] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:01.018281 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-185b6998-20e1-4bfd-9af2-cd085e178135 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:01.018726 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-185b6998-20e1-4bfd-9af2-cd085e178135 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:01.019713 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-185b6998-20e1-4bfd-9af2-cd085e178135 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:01.020157 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-185b6998-20e1-4bfd-9af2-cd085e178135 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:01.035507 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-185b6998-20e1-4bfd-9af2-cd085e178135 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] HTTP exception thrown: Instance 67efe239-0022-4298-878f-42dd83b61165 could not be found. Jan 28 00:59:01.036112 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-185b6998-20e1-4bfd-9af2-cd085e178135 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] Returning 404 to user: Instance 67efe239-0022-4298-878f-42dd83b61165 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:01.036956 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-185b6998-20e1-4bfd-9af2-cd085e178135 tempest-DeleteServersTestJSON-2018417067 tempest-DeleteServersTestJSON-2018417067-project] 10.222.0.78 "GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165" status: 404 len: 111 microversion: 2.1 time: 0.037468 Jan 28 00:59:01.037754 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 92/166] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:00 2022] GET /compute/v2.1/servers/67efe239-0022-4298-878f-42dd83b61165 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:59:01.329264 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4e8409ce-7607-45d8-aba3-0db2895c1b32 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:01.330294 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4e8409ce-7607-45d8-aba3-0db2895c1b32 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:01.336997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e8409ce-7607-45d8-aba3-0db2895c1b32 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:01.337604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e8409ce-7607-45d8-aba3-0db2895c1b32 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:01.338516 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e8409ce-7607-45d8-aba3-0db2895c1b32 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:01.338975 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e8409ce-7607-45d8-aba3-0db2895c1b32 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:01.439498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3e76a503-ca1f-420e-afad-82cdd02f35fb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:01.440194 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3e76a503-ca1f-420e-afad-82cdd02f35fb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:01.449228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e76a503-ca1f-420e-afad-82cdd02f35fb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:01.449937 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e76a503-ca1f-420e-afad-82cdd02f35fb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:01.450974 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e76a503-ca1f-420e-afad-82cdd02f35fb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:01.452110 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e76a503-ca1f-420e-afad-82cdd02f35fb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:01.474077 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4e8409ce-7607-45d8-aba3-0db2895c1b32 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 27644 microversion: 2.20 time: 0.148268 Jan 28 00:59:01.474722 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 75/167] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:01 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 27644 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:01.813435 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3e76a503-ca1f-420e-afad-82cdd02f35fb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:01.823350 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3e76a503-ca1f-420e-afad-82cdd02f35fb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.387820 Jan 28 00:59:01.835572 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 93/168] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:01 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:02.487028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3915d63b-b9e6-4266-b468-65022606ac9e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:02.488505 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3915d63b-b9e6-4266-b468-65022606ac9e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:02.497763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3915d63b-b9e6-4266-b468-65022606ac9e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:02.499466 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3915d63b-b9e6-4266-b468-65022606ac9e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:02.500749 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3915d63b-b9e6-4266-b468-65022606ac9e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:02.501485 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3915d63b-b9e6-4266-b468-65022606ac9e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:02.663672 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3915d63b-b9e6-4266-b468-65022606ac9e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 27809 microversion: 2.20 time: 0.176966 Jan 28 00:59:02.665048 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 76/169] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:02 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 27809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:59:02.859655 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-52e694ff-6add-4d74-8988-accb48286f05 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:02.865437 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-52e694ff-6add-4d74-8988-accb48286f05 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:02.878785 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-52e694ff-6add-4d74-8988-accb48286f05 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:02.879967 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-52e694ff-6add-4d74-8988-accb48286f05 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:02.882248 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-52e694ff-6add-4d74-8988-accb48286f05 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:02.882999 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-52e694ff-6add-4d74-8988-accb48286f05 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:03.226582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-52e694ff-6add-4d74-8988-accb48286f05 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:03.238249 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-52e694ff-6add-4d74-8988-accb48286f05 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.397265 Jan 28 00:59:03.239172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 94/170] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:02 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:03.691562 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b5d6555e-b6de-47d2-bad9-1cd2ebb03470 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:03.695606 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b5d6555e-b6de-47d2-bad9-1cd2ebb03470 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:03.718251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b5d6555e-b6de-47d2-bad9-1cd2ebb03470 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:03.719052 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b5d6555e-b6de-47d2-bad9-1cd2ebb03470 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:03.720911 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b5d6555e-b6de-47d2-bad9-1cd2ebb03470 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:03.721699 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b5d6555e-b6de-47d2-bad9-1cd2ebb03470 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:03.878735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b5d6555e-b6de-47d2-bad9-1cd2ebb03470 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 28187 microversion: 2.20 time: 0.197680 Jan 28 00:59:03.885835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 77/171] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:03 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 28187 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:04.271620 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3d4080a8-dfd7-45e3-bcd8-17ad164ccccc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:04.272297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3d4080a8-dfd7-45e3-bcd8-17ad164ccccc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:04.282849 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3d4080a8-dfd7-45e3-bcd8-17ad164ccccc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:04.283636 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3d4080a8-dfd7-45e3-bcd8-17ad164ccccc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:04.284691 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3d4080a8-dfd7-45e3-bcd8-17ad164ccccc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:04.285312 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3d4080a8-dfd7-45e3-bcd8-17ad164ccccc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:04.507836 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3d4080a8-dfd7-45e3-bcd8-17ad164ccccc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:04.522559 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3d4080a8-dfd7-45e3-bcd8-17ad164ccccc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.257201 Jan 28 00:59:04.523423 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 95/172] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:04 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:04.900081 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cafb02a7-8fbd-4751-b9ea-bc750377d80b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:04.902477 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cafb02a7-8fbd-4751-b9ea-bc750377d80b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:04.919971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cafb02a7-8fbd-4751-b9ea-bc750377d80b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:04.922743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cafb02a7-8fbd-4751-b9ea-bc750377d80b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:04.925222 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cafb02a7-8fbd-4751-b9ea-bc750377d80b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:04.928347 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cafb02a7-8fbd-4751-b9ea-bc750377d80b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:05.543794 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5d49c948-333c-4fad-af03-bd847fda0ce3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:05.544672 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5d49c948-333c-4fad-af03-bd847fda0ce3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:05.552114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d49c948-333c-4fad-af03-bd847fda0ce3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:05.552562 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d49c948-333c-4fad-af03-bd847fda0ce3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:05.553354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d49c948-333c-4fad-af03-bd847fda0ce3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:05.553833 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d49c948-333c-4fad-af03-bd847fda0ce3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:05.861164 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5d49c948-333c-4fad-af03-bd847fda0ce3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:05.871807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5d49c948-333c-4fad-af03-bd847fda0ce3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.332067 Jan 28 00:59:05.872378 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 96/173] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:05 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:06.892744 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-91f3a270-002f-4087-a288-bf2e3162a86d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:06.894346 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-91f3a270-002f-4087-a288-bf2e3162a86d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:06.906695 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-91f3a270-002f-4087-a288-bf2e3162a86d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:06.907730 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-91f3a270-002f-4087-a288-bf2e3162a86d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:06.908631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-91f3a270-002f-4087-a288-bf2e3162a86d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:06.909398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-91f3a270-002f-4087-a288-bf2e3162a86d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:07.193063 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-91f3a270-002f-4087-a288-bf2e3162a86d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:07.210234 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-91f3a270-002f-4087-a288-bf2e3162a86d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.324033 Jan 28 00:59:07.212813 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 97/174] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:06 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:07.475420 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cafb02a7-8fbd-4751-b9ea-bc750377d80b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 28187 microversion: 2.20 time: 2.584436 Jan 28 00:59:07.480114 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 78/175] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:04 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 28187 bytes in 2587 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:08.231333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4517eed1-a459-45df-9bb4-4e135170c5d5 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:08.232814 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4517eed1-a459-45df-9bb4-4e135170c5d5 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:08.238579 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4517eed1-a459-45df-9bb4-4e135170c5d5 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.239071 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4517eed1-a459-45df-9bb4-4e135170c5d5 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.239869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4517eed1-a459-45df-9bb4-4e135170c5d5 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.240318 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4517eed1-a459-45df-9bb4-4e135170c5d5 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.415878 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5fc96a99-11c4-46ae-afbb-33dedeca25a9 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a0952a0d0>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:08.434217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4517eed1-a459-45df-9bb4-4e135170c5d5 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:08.444946 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4517eed1-a459-45df-9bb4-4e135170c5d5 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.217331 Jan 28 00:59:08.445541 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 98/176] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:08 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:08.488565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1c257fc6-fe3c-4529-8842-200bfddb0f03 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:08.489501 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1c257fc6-fe3c-4529-8842-200bfddb0f03 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:08.491155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5fc96a99-11c4-46ae-afbb-33dedeca25a9 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7061b198-447f-4141-86f2-ebc7a53700a7" status: 200 len: 351 microversion: 2.1 time: 0.078054 Jan 28 00:59:08.491725 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 79/177] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:59:08 2022] GET /compute/v2.1/os-volumes/7061b198-447f-4141-86f2-ebc7a53700a7 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:08.496197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c257fc6-fe3c-4529-8842-200bfddb0f03 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.496655 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c257fc6-fe3c-4529-8842-200bfddb0f03 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.497460 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c257fc6-fe3c-4529-8842-200bfddb0f03 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.498081 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c257fc6-fe3c-4529-8842-200bfddb0f03 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.620641 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1c257fc6-fe3c-4529-8842-200bfddb0f03 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 28440 microversion: 2.20 time: 0.136424 Jan 28 00:59:08.625710 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 99/178] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:08 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 28440 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:09.066298 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1641412028", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "networks": [{"uuid": "87529b14-ec97-47b6-b564-089e17ceb8e6"}]}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:09.157618 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] validate_networks() for [('87529b14-ec97-47b6-b564-089e17ceb8e6', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:59:09.468487 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-068a9aee-4998-487c-b010-afd9994d9672 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:09.471229 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-068a9aee-4998-487c-b010-afd9994d9672 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:09.484204 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-068a9aee-4998-487c-b010-afd9994d9672 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.485350 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-068a9aee-4998-487c-b010-afd9994d9672 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:09.488361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-068a9aee-4998-487c-b010-afd9994d9672 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.489839 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-068a9aee-4998-487c-b010-afd9994d9672 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:09.728271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-068a9aee-4998-487c-b010-afd9994d9672 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:09.739808 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-068a9aee-4998-487c-b010-afd9994d9672 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.279456 Jan 28 00:59:09.749819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 100/179] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:09 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:09.749819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-21db8bc4-7186-4801-b364-defbc23f6d09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:09.749819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-21db8bc4-7186-4801-b364-defbc23f6d09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:09.753682 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-21db8bc4-7186-4801-b364-defbc23f6d09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.754130 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-21db8bc4-7186-4801-b364-defbc23f6d09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:09.754943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-21db8bc4-7186-4801-b364-defbc23f6d09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.755375 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-21db8bc4-7186-4801-b364-defbc23f6d09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:09.780172 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:59:09.781193 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:59:09.781965 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:59:09.783129 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:59:09.783820 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:59:09.796501 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.796956 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:09.797774 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.798213 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:09.817293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Getting quotas for project 5aa12e9e43b74e37b418bbc4806a875c. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:59:09.821464 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Getting quotas for user 765eed67607c4ffeb858eda201f9be4a and project 5aa12e9e43b74e37b418bbc4806a875c. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:59:09.832335 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:59:09.834923 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:59:09.878771 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-21db8bc4-7186-4801-b364-defbc23f6d09 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 28478 microversion: 2.20 time: 0.136359 Jan 28 00:59:09.880161 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 101/180] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:09 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 28478 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:09.888573 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8189ab1c-3d20-470a-977b-bd8178fccc1d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827532 Jan 28 00:59:09.889604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 80/181] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 00:59:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:59:09.900589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7ddaa3fe-c151-46d9-bfaf-edb53d1bdd2f tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:09.901574 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7ddaa3fe-c151-46d9-bfaf-edb53d1bdd2f tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:09.971121 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7ddaa3fe-c151-46d9-bfaf-edb53d1bdd2f tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:09.979857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7ddaa3fe-c151-46d9-bfaf-edb53d1bdd2f tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1219 microversion: 2.1 time: 0.083766 Jan 28 00:59:09.980594 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 102/182] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:09 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:10.001333 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c39f11f5-3beb-4bce-afca-e6600cf251c4 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a0956e790>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:10.059242 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c39f11f5-3beb-4bce-afca-e6600cf251c4 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/3edfc3c3-c67d-472a-8c78-54057f389602" status: 200 len: 350 microversion: 2.1 time: 0.062107 Jan 28 00:59:10.059771 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 81/183] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:59:09 2022] GET /compute/v2.1/os-volumes/3edfc3c3-c67d-472a-8c78-54057f389602 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:10.757800 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2bd2f2ef-995c-4d33-837c-8607a0548926 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:10.758436 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2bd2f2ef-995c-4d33-837c-8607a0548926 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:10.766240 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2ef-995c-4d33-837c-8607a0548926 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:10.766945 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2ef-995c-4d33-837c-8607a0548926 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:10.768049 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2ef-995c-4d33-837c-8607a0548926 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:10.768580 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2bd2f2ef-995c-4d33-837c-8607a0548926 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:10.892212 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a14861dc-1141-4d5d-919b-71551fcd335c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:10.893342 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a14861dc-1141-4d5d-919b-71551fcd335c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:10.900377 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a14861dc-1141-4d5d-919b-71551fcd335c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:10.900834 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a14861dc-1141-4d5d-919b-71551fcd335c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:10.902032 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a14861dc-1141-4d5d-919b-71551fcd335c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:10.902477 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a14861dc-1141-4d5d-919b-71551fcd335c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:10.940454 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2bd2f2ef-995c-4d33-837c-8607a0548926 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:10.948260 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2bd2f2ef-995c-4d33-837c-8607a0548926 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.194506 Jan 28 00:59:10.948854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 103/184] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:10 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:10.999803 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4718b90c-f939-4209-a3b4-a8a1c6386b3d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:11.000516 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4718b90c-f939-4209-a3b4-a8a1c6386b3d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:11.009884 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4718b90c-f939-4209-a3b4-a8a1c6386b3d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:11.010900 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4718b90c-f939-4209-a3b4-a8a1c6386b3d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:11.012631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4718b90c-f939-4209-a3b4-a8a1c6386b3d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:11.013513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4718b90c-f939-4209-a3b4-a8a1c6386b3d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:11.034493 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a14861dc-1141-4d5d-919b-71551fcd335c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 28646 microversion: 2.20 time: 0.146480 Jan 28 00:59:11.035164 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 82/185] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:10 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 28646 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:59:11.101732 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4718b90c-f939-4209-a3b4-a8a1c6386b3d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:11.114453 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4718b90c-f939-4209-a3b4-a8a1c6386b3d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1271 microversion: 2.1 time: 0.119639 Jan 28 00:59:11.115140 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 104/186] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:10 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:11.504122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6adedf43-55df-42dc-af09-3c40c5fa8592 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a0952aa60>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:11.580667 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6adedf43-55df-42dc-af09-3c40c5fa8592 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/aae8bd4b-18e2-4b10-86ff-3968b4106e40" status: 200 len: 350 microversion: 2.1 time: 0.078592 Jan 28 00:59:11.582049 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 83/187] 10.222.0.78 () {58 vars in 1244 bytes} [Fri Jan 28 00:59:11 2022] GET /compute/v2.1/os-volumes/aae8bd4b-18e2-4b10-86ff-3968b4106e40 => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:11.594453 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a0a15e5e-3197-49ce-bd56-720138f2e43b tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a0af491f0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:11.691848 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a0a15e5e-3197-49ce-bd56-720138f2e43b tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.101630 Jan 28 00:59:11.692431 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 105/188] 10.222.0.78 () {58 vars in 1133 bytes} [Fri Jan 28 00:59:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:11.706053 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-75e59252-b5bc-4540-a609-45e479e1daeb tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a09e9a3a0>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:11.798984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-75e59252-b5bc-4540-a609-45e479e1daeb tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.098173 Jan 28 00:59:11.799782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 84/189] 10.222.0.78 () {58 vars in 1148 bytes} [Fri Jan 28 00:59:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:11.813176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-00c9f6bb-12db-4a10-8dee-1bcf8f84a0d8 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a09e55310>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:11.931574 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-00c9f6bb-12db-4a10-8dee-1bcf8f84a0d8 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.122496 Jan 28 00:59:11.932141 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 106/190] 10.222.0.78 () {58 vars in 1133 bytes} [Fri Jan 28 00:59:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:11.943869 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d8042078-0b3e-462a-81e7-9ebdc7ed3123 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a09e79a60>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:11.967560 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-db3e905a-3f74-4548-b16a-2ea2bb5daa55 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:11.968367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-db3e905a-3f74-4548-b16a-2ea2bb5daa55 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:11.975175 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-db3e905a-3f74-4548-b16a-2ea2bb5daa55 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:11.975742 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-db3e905a-3f74-4548-b16a-2ea2bb5daa55 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:11.976581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-db3e905a-3f74-4548-b16a-2ea2bb5daa55 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:11.977081 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-db3e905a-3f74-4548-b16a-2ea2bb5daa55 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:12.033961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d8042078-0b3e-462a-81e7-9ebdc7ed3123 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093148 Jan 28 00:59:12.034209 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 85/191] 10.222.0.78 () {58 vars in 1166 bytes} [Fri Jan 28 00:59:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:12.049713 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bd2ad290-6fa3-4617-aa34-7ceb67bd21a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:12.050646 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-bd2ad290-6fa3-4617-aa34-7ceb67bd21a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:12.057637 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bd2ad290-6fa3-4617-aa34-7ceb67bd21a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:12.058359 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bd2ad290-6fa3-4617-aa34-7ceb67bd21a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:12.059215 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bd2ad290-6fa3-4617-aa34-7ceb67bd21a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:12.059821 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bd2ad290-6fa3-4617-aa34-7ceb67bd21a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:12.142962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-db3e905a-3f74-4548-b16a-2ea2bb5daa55 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:12.156330 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-db3e905a-3f74-4548-b16a-2ea2bb5daa55 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.192829 Jan 28 00:59:12.157545 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 107/192] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:11 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:12.173064 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-37339fdf-4d6b-46f0-b29d-f9ebfdb07935 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a094fa280>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:12.423283 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-37339fdf-4d6b-46f0-b29d-f9ebfdb07935 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.263857 Jan 28 00:59:12.423958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 108/193] 10.222.0.78 () {58 vars in 1169 bytes} [Fri Jan 28 00:59:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:12.438166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-36dd195c-c383-46ff-8633-29808ede62ef tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:12.440303 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-36dd195c-c383-46ff-8633-29808ede62ef tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:12.448398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-36dd195c-c383-46ff-8633-29808ede62ef tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:12.448939 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-36dd195c-c383-46ff-8633-29808ede62ef tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:12.451076 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-36dd195c-c383-46ff-8633-29808ede62ef tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:12.451643 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-36dd195c-c383-46ff-8633-29808ede62ef tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:12.590187 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-36dd195c-c383-46ff-8633-29808ede62ef tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:12.598086 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-36dd195c-c383-46ff-8633-29808ede62ef tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1319 microversion: 2.1 time: 0.169811 Jan 28 00:59:12.598660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 109/194] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:12 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:12.602960 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9f5a4d4d-2fc4-45a3-9b30-c83209911e50 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a0960d4c0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:12.686372 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9f5a4d4d-2fc4-45a3-9b30-c83209911e50 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086612 Jan 28 00:59:12.686970 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 110/195] 10.222.0.78 () {58 vars in 1154 bytes} [Fri Jan 28 00:59:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:12.697660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-57223ebd-23f5-4317-b8b7-501455f58fd9 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a094fa8b0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:12.775461 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-57223ebd-23f5-4317-b8b7-501455f58fd9 tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081135 Jan 28 00:59:12.776024 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 111/196] 10.222.0.78 () {58 vars in 1187 bytes} [Fri Jan 28 00:59:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:59:12.787432 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d438bb5f-0140-4327-8f20-0b137e57fcda tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] Calling method '.version_select at 0x7f1a09574d30>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:12.867447 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d438bb5f-0140-4327-8f20-0b137e57fcda tempest-VolumesTestJSON-1300736921 tempest-VolumesTestJSON-1300736921-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083332 Jan 28 00:59:12.868201 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 112/197] 10.222.0.78 () {58 vars in 1154 bytes} [Fri Jan 28 00:59:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:13.179440 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8e483822-1f66-4d62-9161-da8fcd9154b3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:13.180107 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8e483822-1f66-4d62-9161-da8fcd9154b3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:13.187052 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8e483822-1f66-4d62-9161-da8fcd9154b3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:13.187511 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8e483822-1f66-4d62-9161-da8fcd9154b3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:13.188297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8e483822-1f66-4d62-9161-da8fcd9154b3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:13.188736 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8e483822-1f66-4d62-9161-da8fcd9154b3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:13.325714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8e483822-1f66-4d62-9161-da8fcd9154b3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:13.334292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8e483822-1f66-4d62-9161-da8fcd9154b3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.158985 Jan 28 00:59:13.334860 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 113/198] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:13 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:13.617272 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0acd976f-a137-41c6-8b23-ce11c04cd6f7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:13.617961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0acd976f-a137-41c6-8b23-ce11c04cd6f7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:13.624613 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0acd976f-a137-41c6-8b23-ce11c04cd6f7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:13.625058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0acd976f-a137-41c6-8b23-ce11c04cd6f7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:13.625835 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0acd976f-a137-41c6-8b23-ce11c04cd6f7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:13.626283 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0acd976f-a137-41c6-8b23-ce11c04cd6f7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:13.759929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0acd976f-a137-41c6-8b23-ce11c04cd6f7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:13.767544 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0acd976f-a137-41c6-8b23-ce11c04cd6f7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1319 microversion: 2.1 time: 0.155877 Jan 28 00:59:13.768310 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 114/199] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:13 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:14.327561 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bd2ad290-6fa3-4617-aa34-7ceb67bd21a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 28646 microversion: 2.20 time: 2.281637 Jan 28 00:59:14.329366 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 86/200] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:12 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 28646 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:14.351393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-deac74a7-f900-451d-ab4e-73f761a78888 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:14.352097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-deac74a7-f900-451d-ab4e-73f761a78888 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:14.359339 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-deac74a7-f900-451d-ab4e-73f761a78888 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:14.359913 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-deac74a7-f900-451d-ab4e-73f761a78888 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:14.360847 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-deac74a7-f900-451d-ab4e-73f761a78888 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:14.361266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-deac74a7-f900-451d-ab4e-73f761a78888 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:14.522442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-deac74a7-f900-451d-ab4e-73f761a78888 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:14.531153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-deac74a7-f900-451d-ab4e-73f761a78888 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.183299 Jan 28 00:59:14.531734 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 115/201] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:14 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:14.791526 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0238f902-c845-4166-927a-77a0450f1889 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:14.792261 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0238f902-c845-4166-927a-77a0450f1889 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:14.800026 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0238f902-c845-4166-927a-77a0450f1889 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:14.800537 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0238f902-c845-4166-927a-77a0450f1889 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:14.801334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0238f902-c845-4166-927a-77a0450f1889 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:14.801804 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0238f902-c845-4166-927a-77a0450f1889 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:14.968352 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-df1148f1-4f65-4f79-a755-ed3196175bdf req-985a96c5-7cf2-41bd-b050-37170b91d8fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1024b0-1f5b-45b0-9780-abb901287988", "tag": "e8a2f591-0a29-4bfe-a85d-856e9bb034df"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:14.969936 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:59:14.969936 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 00:59:14.977911 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-df1148f1-4f65-4f79-a755-ed3196175bdf req-985a96c5-7cf2-41bd-b050-37170b91d8fc service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:14.978355 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-df1148f1-4f65-4f79-a755-ed3196175bdf req-985a96c5-7cf2-41bd-b050-37170b91d8fc service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:14.993005 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-df1148f1-4f65-4f79-a755-ed3196175bdf req-985a96c5-7cf2-41bd-b050-37170b91d8fc service nova] Creating event network-changed:e8a2f591-0a29-4bfe-a85d-856e9bb034df for instance da1024b0-1f5b-45b0-9780-abb901287988 on hv-cinder-81689 Jan 28 00:59:15.000702 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-df1148f1-4f65-4f79-a755-ed3196175bdf req-985a96c5-7cf2-41bd-b050-37170b91d8fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036119 Jan 28 00:59:15.002226 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 116/202] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:59:15.026324 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0238f902-c845-4166-927a-77a0450f1889 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:15.035960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0238f902-c845-4166-927a-77a0450f1889 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1319 microversion: 2.1 time: 0.248490 Jan 28 00:59:15.036542 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 87/203] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:14 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:15.340643 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-027efaf6-b50b-40ca-85c5-2f05033f51f0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:15.341653 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-027efaf6-b50b-40ca-85c5-2f05033f51f0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:15.348513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-027efaf6-b50b-40ca-85c5-2f05033f51f0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:15.348962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-027efaf6-b50b-40ca-85c5-2f05033f51f0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:15.349751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-027efaf6-b50b-40ca-85c5-2f05033f51f0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:15.350184 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-027efaf6-b50b-40ca-85c5-2f05033f51f0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:15.487690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-027efaf6-b50b-40ca-85c5-2f05033f51f0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 28646 microversion: 2.20 time: 0.150924 Jan 28 00:59:15.488784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 117/204] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:15 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 28646 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:15.548101 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ccb151dd-56f7-4e9a-88b9-d0ff1cc6a35a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:15.548882 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ccb151dd-56f7-4e9a-88b9-d0ff1cc6a35a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:15.555060 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ccb151dd-56f7-4e9a-88b9-d0ff1cc6a35a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:15.555510 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ccb151dd-56f7-4e9a-88b9-d0ff1cc6a35a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:15.556294 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ccb151dd-56f7-4e9a-88b9-d0ff1cc6a35a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:15.556732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ccb151dd-56f7-4e9a-88b9-d0ff1cc6a35a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:15.803208 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ccb151dd-56f7-4e9a-88b9-d0ff1cc6a35a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:15.836956 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ccb151dd-56f7-4e9a-88b9-d0ff1cc6a35a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.292918 Jan 28 00:59:15.838104 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 88/205] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:15 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:16.061253 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0d49c91a-4b5d-4a40-be81-b3c493d51af1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:16.062158 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0d49c91a-4b5d-4a40-be81-b3c493d51af1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:16.069836 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d49c91a-4b5d-4a40-be81-b3c493d51af1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:16.070280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d49c91a-4b5d-4a40-be81-b3c493d51af1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:16.072072 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d49c91a-4b5d-4a40-be81-b3c493d51af1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:16.072696 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d49c91a-4b5d-4a40-be81-b3c493d51af1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:16.249186 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0d49c91a-4b5d-4a40-be81-b3c493d51af1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:16.257486 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0d49c91a-4b5d-4a40-be81-b3c493d51af1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1319 microversion: 2.1 time: 0.201626 Jan 28 00:59:16.258070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 118/206] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:16 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:16.500307 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-854d94d0-b430-4cf8-8f12-6d71dd59e33d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:16.501338 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-854d94d0-b430-4cf8-8f12-6d71dd59e33d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:16.507844 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-854d94d0-b430-4cf8-8f12-6d71dd59e33d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:16.508328 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-854d94d0-b430-4cf8-8f12-6d71dd59e33d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:16.509116 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-854d94d0-b430-4cf8-8f12-6d71dd59e33d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:16.509612 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-854d94d0-b430-4cf8-8f12-6d71dd59e33d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:16.617645 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-854d94d0-b430-4cf8-8f12-6d71dd59e33d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 28646 microversion: 2.20 time: 0.121449 Jan 28 00:59:16.618334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 89/207] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:16 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 28646 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:16.859325 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4e06d484-c3d8-49f9-a5e1-42135c3e7480 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:16.860710 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4e06d484-c3d8-49f9-a5e1-42135c3e7480 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:16.873838 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4e06d484-c3d8-49f9-a5e1-42135c3e7480 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:16.875050 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4e06d484-c3d8-49f9-a5e1-42135c3e7480 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:16.876370 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4e06d484-c3d8-49f9-a5e1-42135c3e7480 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:16.877034 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4e06d484-c3d8-49f9-a5e1-42135c3e7480 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:17.055156 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4e06d484-c3d8-49f9-a5e1-42135c3e7480 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:17.063635 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4e06d484-c3d8-49f9-a5e1-42135c3e7480 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1523 microversion: 2.1 time: 0.212383 Jan 28 00:59:17.064217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 119/208] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:16 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:17.282765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-32e28a0a-c4aa-440b-be03-3fecaa5fef70 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:17.284038 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-32e28a0a-c4aa-440b-be03-3fecaa5fef70 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:17.296604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-32e28a0a-c4aa-440b-be03-3fecaa5fef70 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:17.300171 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-32e28a0a-c4aa-440b-be03-3fecaa5fef70 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:17.300171 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-32e28a0a-c4aa-440b-be03-3fecaa5fef70 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:17.300171 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-32e28a0a-c4aa-440b-be03-3fecaa5fef70 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:17.496868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-32e28a0a-c4aa-440b-be03-3fecaa5fef70 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:17.510818 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-32e28a0a-c4aa-440b-be03-3fecaa5fef70 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1319 microversion: 2.1 time: 0.239563 Jan 28 00:59:17.511715 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 90/209] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:17 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:17.630322 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2a1aaadf-f63d-4e60-a0f4-a7d239d41ac0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:17.631520 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2a1aaadf-f63d-4e60-a0f4-a7d239d41ac0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:17.642104 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a1aaadf-f63d-4e60-a0f4-a7d239d41ac0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:17.642698 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a1aaadf-f63d-4e60-a0f4-a7d239d41ac0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:17.643996 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a1aaadf-f63d-4e60-a0f4-a7d239d41ac0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:17.644659 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a1aaadf-f63d-4e60-a0f4-a7d239d41ac0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:17.769481 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2a1aaadf-f63d-4e60-a0f4-a7d239d41ac0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 28646 microversion: 2.20 time: 0.142781 Jan 28 00:59:17.774984 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 120/210] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:17 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 28646 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:18.081411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-dd3ba69f-4424-41ab-ab68-a620bb070f48 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:18.083664 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-dd3ba69f-4424-41ab-ab68-a620bb070f48 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:18.091585 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dd3ba69f-4424-41ab-ab68-a620bb070f48 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:18.093427 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dd3ba69f-4424-41ab-ab68-a620bb070f48 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:18.099981 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dd3ba69f-4424-41ab-ab68-a620bb070f48 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:18.100814 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dd3ba69f-4424-41ab-ab68-a620bb070f48 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:18.285996 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-dd3ba69f-4424-41ab-ab68-a620bb070f48 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:18.294603 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-dd3ba69f-4424-41ab-ab68-a620bb070f48 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1503 microversion: 2.1 time: 0.217055 Jan 28 00:59:18.295258 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 91/211] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:18 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:18.317005 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b02fea99-388c-4846-955c-85aefe2ee00d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:18.318282 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b02fea99-388c-4846-955c-85aefe2ee00d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:18.327729 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b02fea99-388c-4846-955c-85aefe2ee00d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:18.328497 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b02fea99-388c-4846-955c-85aefe2ee00d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:18.329323 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b02fea99-388c-4846-955c-85aefe2ee00d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:18.329762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b02fea99-388c-4846-955c-85aefe2ee00d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:18.550951 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d297480a-9b1d-489d-97f3-6c89ac4aadbe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:18.552468 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d297480a-9b1d-489d-97f3-6c89ac4aadbe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:18.562609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d297480a-9b1d-489d-97f3-6c89ac4aadbe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:18.563599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d297480a-9b1d-489d-97f3-6c89ac4aadbe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:18.565050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d297480a-9b1d-489d-97f3-6c89ac4aadbe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:18.565670 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d297480a-9b1d-489d-97f3-6c89ac4aadbe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:18.589824 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b02fea99-388c-4846-955c-85aefe2ee00d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:18.609172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b02fea99-388c-4846-955c-85aefe2ee00d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1517 microversion: 2.1 time: 0.298080 Jan 28 00:59:18.611232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 121/212] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:18 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1517 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:18.784840 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4fb14e54-5ce4-4e53-9ba4-f1e72564a503 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:18.785760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4fb14e54-5ce4-4e53-9ba4-f1e72564a503 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:18.787264 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d297480a-9b1d-489d-97f3-6c89ac4aadbe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:18.794045 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4fb14e54-5ce4-4e53-9ba4-f1e72564a503 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:18.794705 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4fb14e54-5ce4-4e53-9ba4-f1e72564a503 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:18.796052 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4fb14e54-5ce4-4e53-9ba4-f1e72564a503 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:18.796485 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4fb14e54-5ce4-4e53-9ba4-f1e72564a503 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:18.804308 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d297480a-9b1d-489d-97f3-6c89ac4aadbe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1319 microversion: 2.1 time: 0.277639 Jan 28 00:59:18.804960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 92/213] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:18 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:18.943404 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4fb14e54-5ce4-4e53-9ba4-f1e72564a503 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 29131 microversion: 2.20 time: 0.162579 Jan 28 00:59:18.943951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 122/214] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:18 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 29131 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:19.831521 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-70ebfa46-2e0a-4178-a445-fdbcdefcc31e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:19.832268 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-70ebfa46-2e0a-4178-a445-fdbcdefcc31e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:19.844627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-70ebfa46-2e0a-4178-a445-fdbcdefcc31e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:19.845960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-70ebfa46-2e0a-4178-a445-fdbcdefcc31e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:19.848756 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-70ebfa46-2e0a-4178-a445-fdbcdefcc31e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:19.849704 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-70ebfa46-2e0a-4178-a445-fdbcdefcc31e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:19.956381 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e62d7bc6-b8a5-4c39-8a48-c47dfc093a49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:19.957975 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e62d7bc6-b8a5-4c39-8a48-c47dfc093a49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:19.968717 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e62d7bc6-b8a5-4c39-8a48-c47dfc093a49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:19.969519 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e62d7bc6-b8a5-4c39-8a48-c47dfc093a49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:19.970822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e62d7bc6-b8a5-4c39-8a48-c47dfc093a49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:19.971724 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e62d7bc6-b8a5-4c39-8a48-c47dfc093a49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:20.121274 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e62d7bc6-b8a5-4c39-8a48-c47dfc093a49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 30477 microversion: 2.20 time: 0.168980 Jan 28 00:59:20.122091 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 123/215] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:19 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 30477 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:20.168830 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-70ebfa46-2e0a-4178-a445-fdbcdefcc31e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:20.185325 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-70ebfa46-2e0a-4178-a445-fdbcdefcc31e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1319 microversion: 2.1 time: 0.359199 Jan 28 00:59:20.186457 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 93/216] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:19 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:20.249809 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0bcd8761-968e-489e-92ac-a4ac2c87d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:20.251292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0bcd8761-968e-489e-92ac-a4ac2c87d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:20.259153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0bcd8761-968e-489e-92ac-a4ac2c87d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:20.259887 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0bcd8761-968e-489e-92ac-a4ac2c87d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:20.261041 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0bcd8761-968e-489e-92ac-a4ac2c87d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:20.261652 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0bcd8761-968e-489e-92ac-a4ac2c87d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:20.296798 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-0bcd8761-968e-489e-92ac-a4ac2c87d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'flavor' on Instance uuid 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:59:20.414542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0bcd8761-968e-489e-92ac-a4ac2c87d07f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/action" status: 200 len: 32 microversion: 2.1 time: 0.170927 Jan 28 00:59:20.415526 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 124/217] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 00:59:20 2022] POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:59:20.424203 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-208dc421-9a5d-47e9-a466-e09c30ddf335 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:20.425131 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-208dc421-9a5d-47e9-a466-e09c30ddf335 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:20.432307 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-208dc421-9a5d-47e9-a466-e09c30ddf335 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:20.433031 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-208dc421-9a5d-47e9-a466-e09c30ddf335 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:20.434153 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-208dc421-9a5d-47e9-a466-e09c30ddf335 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:20.434956 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-208dc421-9a5d-47e9-a466-e09c30ddf335 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:20.561512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-ddd9c59c-ed77-4605-895c-40ee748fbc8d req-4037498f-569d-4e0c-a3fd-df71444601cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1024b0-1f5b-45b0-9780-abb901287988", "name": "network-vif-plugged", "status": "completed", "tag": "e8a2f591-0a29-4bfe-a85d-856e9bb034df"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:20.563164 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:59:20.563164 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 00:59:20.578351 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-ddd9c59c-ed77-4605-895c-40ee748fbc8d req-4037498f-569d-4e0c-a3fd-df71444601cc service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:20.579138 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-ddd9c59c-ed77-4605-895c-40ee748fbc8d req-4037498f-569d-4e0c-a3fd-df71444601cc service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:20.597377 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-ddd9c59c-ed77-4605-895c-40ee748fbc8d req-4037498f-569d-4e0c-a3fd-df71444601cc service nova] Creating event network-vif-plugged:e8a2f591-0a29-4bfe-a85d-856e9bb034df for instance da1024b0-1f5b-45b0-9780-abb901287988 on hv-cinder-81689 Jan 28 00:59:20.604402 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-ddd9c59c-ed77-4605-895c-40ee748fbc8d req-4037498f-569d-4e0c-a3fd-df71444601cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048108 Jan 28 00:59:20.605565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 125/218] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 00:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:20.678499 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-208dc421-9a5d-47e9-a466-e09c30ddf335 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:20.688934 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-208dc421-9a5d-47e9-a466-e09c30ddf335 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.268543 Jan 28 00:59:20.701170 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 94/219] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:20 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:21.134761 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-96df0750-e6d2-4638-8666-18465cfad35d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:21.136563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-96df0750-e6d2-4638-8666-18465cfad35d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:21.145704 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-96df0750-e6d2-4638-8666-18465cfad35d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:21.146248 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-96df0750-e6d2-4638-8666-18465cfad35d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:21.147394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-96df0750-e6d2-4638-8666-18465cfad35d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:21.147918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-96df0750-e6d2-4638-8666-18465cfad35d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:21.207851 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a96b419a-d852-4d9f-a8b1-e78c8e7d97ee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:21.207851 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a96b419a-d852-4d9f-a8b1-e78c8e7d97ee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:21.213427 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a96b419a-d852-4d9f-a8b1-e78c8e7d97ee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:21.213889 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a96b419a-d852-4d9f-a8b1-e78c8e7d97ee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:21.214902 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a96b419a-d852-4d9f-a8b1-e78c8e7d97ee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:21.215344 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a96b419a-d852-4d9f-a8b1-e78c8e7d97ee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:21.414477 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a96b419a-d852-4d9f-a8b1-e78c8e7d97ee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:21.423251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a96b419a-d852-4d9f-a8b1-e78c8e7d97ee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1319 microversion: 2.1 time: 0.223260 Jan 28 00:59:21.431654 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 95/220] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:21 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:21.611363 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-96df0750-e6d2-4638-8666-18465cfad35d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 32364 microversion: 2.20 time: 0.481042 Jan 28 00:59:21.612598 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 126/221] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:21 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 32364 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:21.707201 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ebd86e2c-e84a-40d2-9d28-35e9c1cf9eef tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:21.707819 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ebd86e2c-e84a-40d2-9d28-35e9c1cf9eef tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:21.715716 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ebd86e2c-e84a-40d2-9d28-35e9c1cf9eef tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:21.716173 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ebd86e2c-e84a-40d2-9d28-35e9c1cf9eef tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:21.717005 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ebd86e2c-e84a-40d2-9d28-35e9c1cf9eef tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:21.717446 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ebd86e2c-e84a-40d2-9d28-35e9c1cf9eef tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:21.890258 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ebd86e2c-e84a-40d2-9d28-35e9c1cf9eef tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:21.902865 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ebd86e2c-e84a-40d2-9d28-35e9c1cf9eef tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.199497 Jan 28 00:59:21.904191 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 96/222] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:21 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:22.442289 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d2b544bc-75da-4856-b3c4-1821f01c23f3 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:22.443212 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d2b544bc-75da-4856-b3c4-1821f01c23f3 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:22.459512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d2b544bc-75da-4856-b3c4-1821f01c23f3 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:22.459512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d2b544bc-75da-4856-b3c4-1821f01c23f3 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:22.459512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d2b544bc-75da-4856-b3c4-1821f01c23f3 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:22.460512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d2b544bc-75da-4856-b3c4-1821f01c23f3 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:22.626333 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8e28656e-d6e7-4ca1-948c-5e8be247de1f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:22.628326 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8e28656e-d6e7-4ca1-948c-5e8be247de1f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:22.643460 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8e28656e-d6e7-4ca1-948c-5e8be247de1f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:22.643911 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8e28656e-d6e7-4ca1-948c-5e8be247de1f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:22.644715 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8e28656e-d6e7-4ca1-948c-5e8be247de1f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:22.646065 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8e28656e-d6e7-4ca1-948c-5e8be247de1f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:22.673255 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d2b544bc-75da-4856-b3c4-1821f01c23f3 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:22.681059 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d2b544bc-75da-4856-b3c4-1821f01c23f3 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1319 microversion: 2.1 time: 0.242848 Jan 28 00:59:22.681962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 127/223] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:22 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:22.820003 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8e28656e-d6e7-4ca1-948c-5e8be247de1f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 33137 microversion: 2.20 time: 0.199368 Jan 28 00:59:22.821176 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 97/224] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:22 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 33137 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:22.921768 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c783873f-d4aa-413e-81e1-a8b7c776df17 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:22.922390 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c783873f-d4aa-413e-81e1-a8b7c776df17 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:22.929701 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c783873f-d4aa-413e-81e1-a8b7c776df17 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:22.930155 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c783873f-d4aa-413e-81e1-a8b7c776df17 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:22.931064 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c783873f-d4aa-413e-81e1-a8b7c776df17 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:22.931582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c783873f-d4aa-413e-81e1-a8b7c776df17 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:23.092553 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c783873f-d4aa-413e-81e1-a8b7c776df17 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:23.101367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c783873f-d4aa-413e-81e1-a8b7c776df17 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.183902 Jan 28 00:59:23.101951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 128/225] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:22 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:23.697944 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2f5a6ee2-f5d3-4252-a31e-5181266903ae tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:23.698631 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2f5a6ee2-f5d3-4252-a31e-5181266903ae tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:23.706735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f5a6ee2-f5d3-4252-a31e-5181266903ae tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:23.707483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f5a6ee2-f5d3-4252-a31e-5181266903ae tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:23.708280 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f5a6ee2-f5d3-4252-a31e-5181266903ae tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:23.709073 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f5a6ee2-f5d3-4252-a31e-5181266903ae tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:23.833202 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2bc59fff-6447-43d3-8c1c-c54dcb219a26 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:23.834589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2bc59fff-6447-43d3-8c1c-c54dcb219a26 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:23.841183 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2bc59fff-6447-43d3-8c1c-c54dcb219a26 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:23.841804 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2bc59fff-6447-43d3-8c1c-c54dcb219a26 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:23.842920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2bc59fff-6447-43d3-8c1c-c54dcb219a26 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:23.843375 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2bc59fff-6447-43d3-8c1c-c54dcb219a26 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:23.928740 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2f5a6ee2-f5d3-4252-a31e-5181266903ae tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:23.941150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2f5a6ee2-f5d3-4252-a31e-5181266903ae tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1507 microversion: 2.1 time: 0.247134 Jan 28 00:59:23.942121 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 98/226] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:23 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:23.995782 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2bc59fff-6447-43d3-8c1c-c54dcb219a26 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 33635 microversion: 2.20 time: 0.166636 Jan 28 00:59:23.996456 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 129/227] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:23 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 33635 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:24.117802 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6933ea1c-f42d-4bc7-bb84-dbc5192ee538 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:24.118580 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6933ea1c-f42d-4bc7-bb84-dbc5192ee538 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:24.132112 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6933ea1c-f42d-4bc7-bb84-dbc5192ee538 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:24.132825 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6933ea1c-f42d-4bc7-bb84-dbc5192ee538 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:24.134286 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6933ea1c-f42d-4bc7-bb84-dbc5192ee538 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:24.138136 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6933ea1c-f42d-4bc7-bb84-dbc5192ee538 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:24.334712 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6933ea1c-f42d-4bc7-bb84-dbc5192ee538 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:24.343267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6933ea1c-f42d-4bc7-bb84-dbc5192ee538 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.229145 Jan 28 00:59:24.344928 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 99/228] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:24 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:25.008847 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3a357deb-ff56-4f21-b96d-f1cccdce8847 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:25.010608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3a357deb-ff56-4f21-b96d-f1cccdce8847 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:25.018652 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a357deb-ff56-4f21-b96d-f1cccdce8847 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:25.020283 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a357deb-ff56-4f21-b96d-f1cccdce8847 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:25.022487 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a357deb-ff56-4f21-b96d-f1cccdce8847 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:25.023098 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a357deb-ff56-4f21-b96d-f1cccdce8847 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:25.159456 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3a357deb-ff56-4f21-b96d-f1cccdce8847 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 34328 microversion: 2.20 time: 0.154997 Jan 28 00:59:25.160357 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 130/229] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:25 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 34328 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:25.362113 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-545736ba-3c66-4ae0-a0ce-326c8d4eff56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:25.362717 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-545736ba-3c66-4ae0-a0ce-326c8d4eff56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:25.371738 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-545736ba-3c66-4ae0-a0ce-326c8d4eff56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:25.372639 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-545736ba-3c66-4ae0-a0ce-326c8d4eff56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:25.373857 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-545736ba-3c66-4ae0-a0ce-326c8d4eff56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:25.374547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-545736ba-3c66-4ae0-a0ce-326c8d4eff56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:25.570483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-545736ba-3c66-4ae0-a0ce-326c8d4eff56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:25.579284 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-545736ba-3c66-4ae0-a0ce-326c8d4eff56 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.220666 Jan 28 00:59:25.580016 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 100/230] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:25 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:26.172928 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7e768fe0-d2ce-4c39-8ae0-581bc3960576 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:26.173818 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7e768fe0-d2ce-4c39-8ae0-581bc3960576 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:26.182107 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7e768fe0-d2ce-4c39-8ae0-581bc3960576 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:26.182774 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7e768fe0-d2ce-4c39-8ae0-581bc3960576 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:26.183690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7e768fe0-d2ce-4c39-8ae0-581bc3960576 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:26.184218 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7e768fe0-d2ce-4c39-8ae0-581bc3960576 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:26.316916 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7e768fe0-d2ce-4c39-8ae0-581bc3960576 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 35095 microversion: 2.20 time: 0.148365 Jan 28 00:59:26.317895 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 131/231] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:26 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 35095 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:26.599701 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-238ffcdc-40b4-4293-9fff-f1ded09a7499 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:26.600312 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-238ffcdc-40b4-4293-9fff-f1ded09a7499 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:26.608760 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-238ffcdc-40b4-4293-9fff-f1ded09a7499 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:26.609211 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-238ffcdc-40b4-4293-9fff-f1ded09a7499 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:26.610170 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-238ffcdc-40b4-4293-9fff-f1ded09a7499 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:26.610576 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-238ffcdc-40b4-4293-9fff-f1ded09a7499 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:26.860326 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-238ffcdc-40b4-4293-9fff-f1ded09a7499 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:26.869240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-238ffcdc-40b4-4293-9fff-f1ded09a7499 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.273253 Jan 28 00:59:26.869825 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 101/232] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:26 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:27.331428 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-06853efe-2fcd-43bd-91c7-f5123edf835c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:27.333185 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-06853efe-2fcd-43bd-91c7-f5123edf835c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:27.342282 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-06853efe-2fcd-43bd-91c7-f5123edf835c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.343053 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-06853efe-2fcd-43bd-91c7-f5123edf835c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:27.343990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-06853efe-2fcd-43bd-91c7-f5123edf835c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.344493 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-06853efe-2fcd-43bd-91c7-f5123edf835c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:27.486965 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-06853efe-2fcd-43bd-91c7-f5123edf835c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 35673 microversion: 2.20 time: 0.160566 Jan 28 00:59:27.488660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 132/233] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:27 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 35673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:59:27.890741 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-99a8a8ed-ef28-48ba-b1b7-0feeef59bd24 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:27.892346 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-99a8a8ed-ef28-48ba-b1b7-0feeef59bd24 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:27.905794 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99a8a8ed-ef28-48ba-b1b7-0feeef59bd24 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.907391 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99a8a8ed-ef28-48ba-b1b7-0feeef59bd24 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:27.909057 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99a8a8ed-ef28-48ba-b1b7-0feeef59bd24 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.910095 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99a8a8ed-ef28-48ba-b1b7-0feeef59bd24 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:28.161463 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-99a8a8ed-ef28-48ba-b1b7-0feeef59bd24 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:28.175393 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-99a8a8ed-ef28-48ba-b1b7-0feeef59bd24 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.290688 Jan 28 00:59:28.177316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 102/234] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:27 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:28.508104 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-82a2784a-3d7c-4305-8e07-16de131e5a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:28.509857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-82a2784a-3d7c-4305-8e07-16de131e5a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:28.523236 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-82a2784a-3d7c-4305-8e07-16de131e5a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:28.524176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-82a2784a-3d7c-4305-8e07-16de131e5a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:28.525626 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-82a2784a-3d7c-4305-8e07-16de131e5a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:28.526804 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-82a2784a-3d7c-4305-8e07-16de131e5a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:29.196358 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9b19442a-a574-4689-970f-3015d005f29b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:29.196982 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9b19442a-a574-4689-970f-3015d005f29b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:29.203536 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9b19442a-a574-4689-970f-3015d005f29b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:29.204232 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9b19442a-a574-4689-970f-3015d005f29b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:29.205624 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9b19442a-a574-4689-970f-3015d005f29b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:29.206598 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9b19442a-a574-4689-970f-3015d005f29b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:29.355681 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-9b19442a-a574-4689-970f-3015d005f29b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:29.363715 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9b19442a-a574-4689-970f-3015d005f29b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.173405 Jan 28 00:59:29.364425 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 103/235] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:29 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:30.384282 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b85081e1-e07f-42ba-8d51-5f5f427c269a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:30.385715 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b85081e1-e07f-42ba-8d51-5f5f427c269a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:30.392742 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b85081e1-e07f-42ba-8d51-5f5f427c269a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:30.393484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b85081e1-e07f-42ba-8d51-5f5f427c269a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:30.394474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b85081e1-e07f-42ba-8d51-5f5f427c269a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:30.395114 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b85081e1-e07f-42ba-8d51-5f5f427c269a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:30.564520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b85081e1-e07f-42ba-8d51-5f5f427c269a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:30.579264 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b85081e1-e07f-42ba-8d51-5f5f427c269a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.198489 Jan 28 00:59:30.579865 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 104/236] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:30 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:31.306373 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-82a2784a-3d7c-4305-8e07-16de131e5a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 37764 microversion: 2.20 time: 2.806429 Jan 28 00:59:31.307356 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 133/237] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:28 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 37764 bytes in 2810 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:31.597383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1fbcc898-836d-40cf-a4e6-e18b9f64dcd4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:31.598079 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1fbcc898-836d-40cf-a4e6-e18b9f64dcd4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:31.606518 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fbcc898-836d-40cf-a4e6-e18b9f64dcd4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.607917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fbcc898-836d-40cf-a4e6-e18b9f64dcd4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.608958 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fbcc898-836d-40cf-a4e6-e18b9f64dcd4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.609505 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fbcc898-836d-40cf-a4e6-e18b9f64dcd4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.798474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1fbcc898-836d-40cf-a4e6-e18b9f64dcd4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:31.810846 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1fbcc898-836d-40cf-a4e6-e18b9f64dcd4 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.216399 Jan 28 00:59:31.812368 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 105/238] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:31 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:32.323161 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-df325b49-52fb-41c6-a8f5-0b31de2998ed tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:32.324206 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-df325b49-52fb-41c6-a8f5-0b31de2998ed tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:32.334047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-df325b49-52fb-41c6-a8f5-0b31de2998ed tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:32.334498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-df325b49-52fb-41c6-a8f5-0b31de2998ed tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:32.335392 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-df325b49-52fb-41c6-a8f5-0b31de2998ed tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:32.336277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-df325b49-52fb-41c6-a8f5-0b31de2998ed tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:32.486727 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-df325b49-52fb-41c6-a8f5-0b31de2998ed tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 38178 microversion: 2.20 time: 0.170206 Jan 28 00:59:32.487953 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 134/239] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:32 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 38178 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:32.831733 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d2d6d6d0-1b71-47e8-8506-11bf80ccfe18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:32.832883 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d2d6d6d0-1b71-47e8-8506-11bf80ccfe18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:32.840899 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d2d6d6d0-1b71-47e8-8506-11bf80ccfe18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:32.842946 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d2d6d6d0-1b71-47e8-8506-11bf80ccfe18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:32.842946 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d2d6d6d0-1b71-47e8-8506-11bf80ccfe18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:32.842946 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d2d6d6d0-1b71-47e8-8506-11bf80ccfe18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:33.099307 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d2d6d6d0-1b71-47e8-8506-11bf80ccfe18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:33.107647 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d2d6d6d0-1b71-47e8-8506-11bf80ccfe18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.281517 Jan 28 00:59:33.108597 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 106/240] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:32 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:33.507369 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2dad157b-e733-4c29-ab1d-dcf7ee801345 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:33.509277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2dad157b-e733-4c29-ab1d-dcf7ee801345 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:33.517174 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2dad157b-e733-4c29-ab1d-dcf7ee801345 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:33.517791 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2dad157b-e733-4c29-ab1d-dcf7ee801345 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:33.518622 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2dad157b-e733-4c29-ab1d-dcf7ee801345 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:33.519088 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2dad157b-e733-4c29-ab1d-dcf7ee801345 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:33.649819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2dad157b-e733-4c29-ab1d-dcf7ee801345 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 38259 microversion: 2.20 time: 0.151590 Jan 28 00:59:33.650946 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 135/241] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:33 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 38259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:34.126058 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a3658fa3-b955-47b7-ad91-151bc2027ede tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:34.126730 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a3658fa3-b955-47b7-ad91-151bc2027ede tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:34.134965 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a3658fa3-b955-47b7-ad91-151bc2027ede tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:34.135653 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a3658fa3-b955-47b7-ad91-151bc2027ede tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:34.137088 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a3658fa3-b955-47b7-ad91-151bc2027ede tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:34.137825 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a3658fa3-b955-47b7-ad91-151bc2027ede tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:34.571274 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a3658fa3-b955-47b7-ad91-151bc2027ede tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:34.583207 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a3658fa3-b955-47b7-ad91-151bc2027ede tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.461161 Jan 28 00:59:34.595148 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 107/242] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:34 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:34.667697 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c84dfbed-b9b9-446f-bb02-f78c8907f1c3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:34.669150 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c84dfbed-b9b9-446f-bb02-f78c8907f1c3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:34.679017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c84dfbed-b9b9-446f-bb02-f78c8907f1c3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:34.679828 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c84dfbed-b9b9-446f-bb02-f78c8907f1c3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:34.681002 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c84dfbed-b9b9-446f-bb02-f78c8907f1c3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:34.681800 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c84dfbed-b9b9-446f-bb02-f78c8907f1c3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:34.797669 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c84dfbed-b9b9-446f-bb02-f78c8907f1c3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 200 len: 38320 microversion: 2.20 time: 0.136750 Jan 28 00:59:34.803070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 136/243] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:34 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 38320 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:34.811962 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f7fa02c6-2ac4-460b-bf9a-7c3a0dad8cba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:34.812472 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f7fa02c6-2ac4-460b-bf9a-7c3a0dad8cba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:34.818688 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7fa02c6-2ac4-460b-bf9a-7c3a0dad8cba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:34.819495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7fa02c6-2ac4-460b-bf9a-7c3a0dad8cba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:34.820734 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7fa02c6-2ac4-460b-bf9a-7c3a0dad8cba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:34.821237 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7fa02c6-2ac4-460b-bf9a-7c3a0dad8cba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:35.013792 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f7fa02c6-2ac4-460b-bf9a-7c3a0dad8cba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/ips" status: 200 len: 150 microversion: 2.20 time: 0.208500 Jan 28 00:59:35.014755 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 108/244] 10.222.0.78 () {60 vars in 1288 bytes} [Fri Jan 28 00:59:34 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/ips => generated 150 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:59:35.601625 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d9c0b4de-58f7-4865-a3a3-97a4ee28e983 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:35.602333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d9c0b4de-58f7-4865-a3a3-97a4ee28e983 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:35.612858 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d9c0b4de-58f7-4865-a3a3-97a4ee28e983 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:35.613321 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d9c0b4de-58f7-4865-a3a3-97a4ee28e983 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:35.614125 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d9c0b4de-58f7-4865-a3a3-97a4ee28e983 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:35.615850 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d9c0b4de-58f7-4865-a3a3-97a4ee28e983 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:35.800060 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d9c0b4de-58f7-4865-a3a3-97a4ee28e983 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:35.807590 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d9c0b4de-58f7-4865-a3a3-97a4ee28e983 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.210113 Jan 28 00:59:35.808327 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 137/245] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:35 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:36.826146 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-75a723ce-cda6-43a3-aa8b-1a293e7216c2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:36.827156 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-75a723ce-cda6-43a3-aa8b-1a293e7216c2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:36.833668 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-75a723ce-cda6-43a3-aa8b-1a293e7216c2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:36.834119 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-75a723ce-cda6-43a3-aa8b-1a293e7216c2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:36.834925 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-75a723ce-cda6-43a3-aa8b-1a293e7216c2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:36.835369 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-75a723ce-cda6-43a3-aa8b-1a293e7216c2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:36.973883 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-75a723ce-cda6-43a3-aa8b-1a293e7216c2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:36.981324 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-75a723ce-cda6-43a3-aa8b-1a293e7216c2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.159425 Jan 28 00:59:36.981887 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 109/246] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:36 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:37.998834 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c02e7702-cb75-4502-bd25-f8d84a473ab2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:37.999432 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c02e7702-cb75-4502-bd25-f8d84a473ab2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:38.005801 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c02e7702-cb75-4502-bd25-f8d84a473ab2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:38.006255 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c02e7702-cb75-4502-bd25-f8d84a473ab2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:38.007084 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c02e7702-cb75-4502-bd25-f8d84a473ab2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:38.007524 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c02e7702-cb75-4502-bd25-f8d84a473ab2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:38.138374 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c02e7702-cb75-4502-bd25-f8d84a473ab2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:38.145687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c02e7702-cb75-4502-bd25-f8d84a473ab2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.151149 Jan 28 00:59:38.146256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 138/247] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:37 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:39.162427 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-380e2e48-a8aa-4a28-89ab-635190b4d2e8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:39.163060 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-380e2e48-a8aa-4a28-89ab-635190b4d2e8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:39.169489 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-380e2e48-a8aa-4a28-89ab-635190b4d2e8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:39.169934 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-380e2e48-a8aa-4a28-89ab-635190b4d2e8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:39.170735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-380e2e48-a8aa-4a28-89ab-635190b4d2e8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:39.171194 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-380e2e48-a8aa-4a28-89ab-635190b4d2e8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:39.299946 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-380e2e48-a8aa-4a28-89ab-635190b4d2e8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:39.307459 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-380e2e48-a8aa-4a28-89ab-635190b4d2e8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.148599 Jan 28 00:59:39.308024 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 110/248] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:39 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:40.324817 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6615ebdd-e7d0-4636-9e44-50a6ca80de47 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:40.325422 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6615ebdd-e7d0-4636-9e44-50a6ca80de47 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:40.332329 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6615ebdd-e7d0-4636-9e44-50a6ca80de47 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:40.332771 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6615ebdd-e7d0-4636-9e44-50a6ca80de47 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:40.333563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6615ebdd-e7d0-4636-9e44-50a6ca80de47 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:40.334000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6615ebdd-e7d0-4636-9e44-50a6ca80de47 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:40.468651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6615ebdd-e7d0-4636-9e44-50a6ca80de47 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:40.476056 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6615ebdd-e7d0-4636-9e44-50a6ca80de47 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.154886 Jan 28 00:59:40.476623 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 139/249] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:40 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:41.493028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3f1c6fb2-a853-4597-b5c8-c62fd0af28db tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:41.493632 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3f1c6fb2-a853-4597-b5c8-c62fd0af28db tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:41.500232 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f1c6fb2-a853-4597-b5c8-c62fd0af28db tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:41.500675 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f1c6fb2-a853-4597-b5c8-c62fd0af28db tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:41.501455 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f1c6fb2-a853-4597-b5c8-c62fd0af28db tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:41.501891 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f1c6fb2-a853-4597-b5c8-c62fd0af28db tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:41.712495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3f1c6fb2-a853-4597-b5c8-c62fd0af28db tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:41.720634 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3f1c6fb2-a853-4597-b5c8-c62fd0af28db tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.231211 Jan 28 00:59:41.721208 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 111/250] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:41 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:42.737597 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b4fb7e1e-60c8-4626-aef4-25aa11f75a95 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:42.738304 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b4fb7e1e-60c8-4626-aef4-25aa11f75a95 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:42.744760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b4fb7e1e-60c8-4626-aef4-25aa11f75a95 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:42.745208 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b4fb7e1e-60c8-4626-aef4-25aa11f75a95 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:42.745998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b4fb7e1e-60c8-4626-aef4-25aa11f75a95 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:42.746436 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b4fb7e1e-60c8-4626-aef4-25aa11f75a95 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:42.889538 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b4fb7e1e-60c8-4626-aef4-25aa11f75a95 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:42.897301 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b4fb7e1e-60c8-4626-aef4-25aa11f75a95 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.163541 Jan 28 00:59:42.897850 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 140/251] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:42 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:43.916458 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ff7d52fc-dea1-419d-947c-762ce340dc18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:43.917746 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ff7d52fc-dea1-419d-947c-762ce340dc18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:43.925837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ff7d52fc-dea1-419d-947c-762ce340dc18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:43.926296 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ff7d52fc-dea1-419d-947c-762ce340dc18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:43.927118 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ff7d52fc-dea1-419d-947c-762ce340dc18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:43.928012 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ff7d52fc-dea1-419d-947c-762ce340dc18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:44.100224 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-11024ce6-4a57-4083-a7c1-064b6d8bbf9d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:44.100853 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-11024ce6-4a57-4083-a7c1-064b6d8bbf9d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:44.108307 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-11024ce6-4a57-4083-a7c1-064b6d8bbf9d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:44.108842 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-11024ce6-4a57-4083-a7c1-064b6d8bbf9d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:44.109647 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-11024ce6-4a57-4083-a7c1-064b6d8bbf9d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:44.110295 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-11024ce6-4a57-4083-a7c1-064b6d8bbf9d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:44.134436 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-11024ce6-4a57-4083-a7c1-064b6d8bbf9d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lazy-loading 'flavor' on Instance uuid b8ab5025-62f7-40d2-b976-95ed4c6f0499 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:59:44.141822 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ff7d52fc-dea1-419d-947c-762ce340dc18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:44.151671 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ff7d52fc-dea1-419d-947c-762ce340dc18 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.240415 Jan 28 00:59:44.152375 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 112/252] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:43 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:44.457411 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-11024ce6-4a57-4083-a7c1-064b6d8bbf9d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 202 len: 0 microversion: 2.20 time: 0.360739 Jan 28 00:59:44.458935 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 141/253] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 00:59:44 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:59:44.466877 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:44.467775 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:44.474004 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:44.474713 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:44.475824 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:44.476414 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:44.619735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:44.628576 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:44.630131 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:44.631346 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-42937dbf-2143-4580-82d6-54ed97c9f286 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.168813 Jan 28 00:59:44.631904 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 113/254] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:44 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:45.181157 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6f8a4a35-07a2-4cfd-8ff4-3c03a4cfd6c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:45.182522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6f8a4a35-07a2-4cfd-8ff4-3c03a4cfd6c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:45.192870 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6f8a4a35-07a2-4cfd-8ff4-3c03a4cfd6c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:45.193325 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6f8a4a35-07a2-4cfd-8ff4-3c03a4cfd6c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:45.194118 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6f8a4a35-07a2-4cfd-8ff4-3c03a4cfd6c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:45.194738 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6f8a4a35-07a2-4cfd-8ff4-3c03a4cfd6c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:45.344813 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6f8a4a35-07a2-4cfd-8ff4-3c03a4cfd6c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:45.353105 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6f8a4a35-07a2-4cfd-8ff4-3c03a4cfd6c1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.176571 Jan 28 00:59:45.364116 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 142/255] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:45 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:45.650606 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:45.651241 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:45.659225 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:45.659702 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:45.660665 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:45.661522 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:45.832128 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:45.843164 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:45.845093 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:45.846260 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c3b6800b-d73a-4d9a-a247-d6a19773395f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.199781 Jan 28 00:59:45.846826 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 114/256] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:45 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:46.376859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bce91635-2dc4-4760-ae3a-dfd779d2ca27 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:46.378081 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bce91635-2dc4-4760-ae3a-dfd779d2ca27 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:46.388522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bce91635-2dc4-4760-ae3a-dfd779d2ca27 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.389262 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bce91635-2dc4-4760-ae3a-dfd779d2ca27 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.390579 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bce91635-2dc4-4760-ae3a-dfd779d2ca27 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.391613 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bce91635-2dc4-4760-ae3a-dfd779d2ca27 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.531681 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-bce91635-2dc4-4760-ae3a-dfd779d2ca27 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:46.539601 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-bce91635-2dc4-4760-ae3a-dfd779d2ca27 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1503 microversion: 2.1 time: 0.170399 Jan 28 00:59:46.540343 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 143/257] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:46 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:46.557601 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3219ae6a-afaa-4e39-a9fc-7966c86e94af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "287717c2-08ab-49c7-98a8-9e7c597ac4e8"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:46.558731 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3219ae6a-afaa-4e39-a9fc-7966c86e94af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:46.565785 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3219ae6a-afaa-4e39-a9fc-7966c86e94af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.566244 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3219ae6a-afaa-4e39-a9fc-7966c86e94af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.567087 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3219ae6a-afaa-4e39-a9fc-7966c86e94af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.567531 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3219ae6a-afaa-4e39-a9fc-7966c86e94af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.594677 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-3219ae6a-afaa-4e39-a9fc-7966c86e94af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] HTTP exception thrown: Cannot 'attach_volume' instance 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 while it is in vm_state rescued Jan 28 00:59:46.595311 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3219ae6a-afaa-4e39-a9fc-7966c86e94af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Returning 409 to user: Cannot 'attach_volume' instance 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 while it is in vm_state rescued {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:46.596152 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3219ae6a-afaa-4e39-a9fc-7966c86e94af tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043049 Jan 28 00:59:46.596884 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 115/258] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 00:59:46 2022] POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 00:59:46.607714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0c3ac523-8914-4ad2-95f9-40dde6abf291 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:46.608321 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0c3ac523-8914-4ad2-95f9-40dde6abf291 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:46.614328 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0c3ac523-8914-4ad2-95f9-40dde6abf291 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.614781 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0c3ac523-8914-4ad2-95f9-40dde6abf291 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.615646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0c3ac523-8914-4ad2-95f9-40dde6abf291 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.616082 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0c3ac523-8914-4ad2-95f9-40dde6abf291 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.705388 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0c3ac523-8914-4ad2-95f9-40dde6abf291 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/action" status: 202 len: 0 microversion: 2.1 time: 0.103188 Jan 28 00:59:46.706112 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 144/259] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 00:59:46 2022] POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:46.714222 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c97d0655-c9d2-4085-bdfb-163eeadaa273 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:46.715522 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c97d0655-c9d2-4085-bdfb-163eeadaa273 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:46.724566 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c97d0655-c9d2-4085-bdfb-163eeadaa273 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.725229 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c97d0655-c9d2-4085-bdfb-163eeadaa273 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.726220 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c97d0655-c9d2-4085-bdfb-163eeadaa273 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.726854 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c97d0655-c9d2-4085-bdfb-163eeadaa273 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.868922 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:46.873014 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:46.903295 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.904660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.906414 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:46.907492 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:46.966837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c97d0655-c9d2-4085-bdfb-163eeadaa273 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:46.978613 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c97d0655-c9d2-4085-bdfb-163eeadaa273 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1511 microversion: 2.1 time: 0.267503 Jan 28 00:59:46.992479 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 116/260] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:46 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:47.169626 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:47.183879 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:47.186216 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:47.187614 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c67e3f17-da83-4b58-82e6-6ffb985dd9a8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.326070 Jan 28 00:59:47.188840 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 145/261] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:46 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:47.997085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-037c25bf-a94b-45b6-b631-7b0c1d05114c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:47.997697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-037c25bf-a94b-45b6-b631-7b0c1d05114c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:48.005246 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-037c25bf-a94b-45b6-b631-7b0c1d05114c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:48.005697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-037c25bf-a94b-45b6-b631-7b0c1d05114c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:48.006767 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-037c25bf-a94b-45b6-b631-7b0c1d05114c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:48.007180 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-037c25bf-a94b-45b6-b631-7b0c1d05114c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:48.152003 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-037c25bf-a94b-45b6-b631-7b0c1d05114c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:48.161163 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-037c25bf-a94b-45b6-b631-7b0c1d05114c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1511 microversion: 2.1 time: 0.167703 Jan 28 00:59:48.161747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 117/262] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:47 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:48.205857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:48.206752 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:48.213200 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:48.213654 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:48.214474 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:48.214940 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:48.355737 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:48.363814 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:48.365340 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:48.366664 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-256e5da3-dabb-4e72-88df-0709cad26614 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.164437 Jan 28 00:59:48.367109 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 146/263] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:48 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:49.177368 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1ba24e06-d656-419b-9a7b-2a74263b83d2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:49.178009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1ba24e06-d656-419b-9a7b-2a74263b83d2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:49.187419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1ba24e06-d656-419b-9a7b-2a74263b83d2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:49.188429 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1ba24e06-d656-419b-9a7b-2a74263b83d2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:49.188953 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1ba24e06-d656-419b-9a7b-2a74263b83d2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:49.189418 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1ba24e06-d656-419b-9a7b-2a74263b83d2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:49.321244 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1ba24e06-d656-419b-9a7b-2a74263b83d2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:49.331277 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1ba24e06-d656-419b-9a7b-2a74263b83d2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1511 microversion: 2.1 time: 0.157530 Jan 28 00:59:49.331847 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 118/264] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:49 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:49.384895 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:49.385503 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:49.391857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:49.392313 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:49.393430 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:49.393678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:49.532051 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:49.542915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:49.544929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:49.546092 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6b14d9d2-e158-4cf5-85a8-b93c6bf032ee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.164827 Jan 28 00:59:49.546646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 147/265] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:49 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:50.347962 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ba7b29f5-2fd7-46e0-ba3e-1221af0a2d68 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:50.348558 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ba7b29f5-2fd7-46e0-ba3e-1221af0a2d68 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:50.354867 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ba7b29f5-2fd7-46e0-ba3e-1221af0a2d68 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:50.355455 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ba7b29f5-2fd7-46e0-ba3e-1221af0a2d68 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:50.356365 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ba7b29f5-2fd7-46e0-ba3e-1221af0a2d68 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:50.357372 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ba7b29f5-2fd7-46e0-ba3e-1221af0a2d68 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:50.498192 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ba7b29f5-2fd7-46e0-ba3e-1221af0a2d68 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:50.505453 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ba7b29f5-2fd7-46e0-ba3e-1221af0a2d68 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1511 microversion: 2.1 time: 0.161110 Jan 28 00:59:50.506022 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 119/266] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:50 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:50.564745 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:50.565348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:50.571574 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:50.572023 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:50.572795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:50.573230 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:50.701595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:50.709257 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:50.710872 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:50.712085 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-bbb97002-8a95-44ef-8f45-964239fa2e3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.151013 Jan 28 00:59:50.712636 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 148/267] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:50 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:51.522540 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6f8be936-a900-4807-a0b7-493d46f3e74e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:51.523144 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6f8be936-a900-4807-a0b7-493d46f3e74e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:51.529567 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6f8be936-a900-4807-a0b7-493d46f3e74e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.530020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6f8be936-a900-4807-a0b7-493d46f3e74e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.530811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6f8be936-a900-4807-a0b7-493d46f3e74e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.531289 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6f8be936-a900-4807-a0b7-493d46f3e74e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.666989 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6f8be936-a900-4807-a0b7-493d46f3e74e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:51.675405 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6f8be936-a900-4807-a0b7-493d46f3e74e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1511 microversion: 2.1 time: 0.156928 Jan 28 00:59:51.675993 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 120/268] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:51 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:51.732758 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:51.733443 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:51.739944 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.740451 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.741239 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.741672 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.886998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:51.895930 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:51.897422 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:51.898621 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-73766fb4-943f-45ae-b98e-84bd05ee82cf tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.170288 Jan 28 00:59:51.899798 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 149/269] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:51 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:52.693090 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-37fb8c5b-f9e4-4e53-8288-1c32e3664327 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:52.693723 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-37fb8c5b-f9e4-4e53-8288-1c32e3664327 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:52.701003 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-37fb8c5b-f9e4-4e53-8288-1c32e3664327 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:52.701480 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-37fb8c5b-f9e4-4e53-8288-1c32e3664327 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:52.702464 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-37fb8c5b-f9e4-4e53-8288-1c32e3664327 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:52.702948 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-37fb8c5b-f9e4-4e53-8288-1c32e3664327 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:52.837679 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-37fb8c5b-f9e4-4e53-8288-1c32e3664327 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:52.846653 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-37fb8c5b-f9e4-4e53-8288-1c32e3664327 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1517 microversion: 2.1 time: 0.157376 Jan 28 00:59:52.847520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 121/270] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:52 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:52.921097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:52.921700 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:52.929831 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:52.930037 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:52.930816 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:52.931279 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:53.098246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:53.102226 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:53.103956 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:53.105538 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f93ad8ef-ef24-48c5-81cb-489a87138680 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.188036 Jan 28 00:59:53.107153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 150/271] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:52 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:54.125792 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:54.126419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:54.132764 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.133223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.134020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.134501 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.224066 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ee827672-cc51-4d1f-9a97-e4c35841701d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:54.225049 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ee827672-cc51-4d1f-9a97-e4c35841701d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:54.232991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ee827672-cc51-4d1f-9a97-e4c35841701d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.233770 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ee827672-cc51-4d1f-9a97-e4c35841701d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.235140 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ee827672-cc51-4d1f-9a97-e4c35841701d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.235757 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ee827672-cc51-4d1f-9a97-e4c35841701d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.284553 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:54.293023 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:54.295240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:54.296381 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3f44adb4-6d0a-4250-b080-c58a6b3e0d42 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.174801 Jan 28 00:59:54.296980 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 122/272] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:54 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:54.385353 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ee827672-cc51-4d1f-9a97-e4c35841701d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:54.393182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ee827672-cc51-4d1f-9a97-e4c35841701d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1517 microversion: 2.1 time: 0.173449 Jan 28 00:59:54.393730 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 151/273] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:54 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:54.409922 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7865e55d-517d-4321-9555-01a94067bde6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e199043-cef6-4f9d-862b-bd6b0bacda7b"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:54.411002 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7865e55d-517d-4321-9555-01a94067bde6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:54.416811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7865e55d-517d-4321-9555-01a94067bde6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.417551 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7865e55d-517d-4321-9555-01a94067bde6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.418509 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7865e55d-517d-4321-9555-01a94067bde6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.419071 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7865e55d-517d-4321-9555-01a94067bde6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.726340 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7865e55d-517d-4321-9555-01a94067bde6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319475 Jan 28 00:59:54.730736 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 123/274] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 00:59:54 2022] POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:55.315347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:55.316006 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:55.322859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:55.323344 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:55.324170 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:55.324604 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:55.540270 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:55.548641 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:55.554233 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:55.555399 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e646e5de-67b6-458c-8742-5cf4263a719b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.243893 Jan 28 00:59:55.555965 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 152/275] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:55 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:56.573135 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:56.573837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:56.580595 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:56.581048 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:56.581892 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:56.582304 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:56.725031 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:56.735249 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:56.736931 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:56.738250 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c0be5590-e3c3-4134-ab50-388c906afe91 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.169178 Jan 28 00:59:56.738815 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 124/276] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:56 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:57.394134 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1981683523", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "networks": [{"uuid": "e44d5089-38c5-4112-a3d1-3d8601d191f4"}]}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:57.448374 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] validate_networks() for [('e44d5089-38c5-4112-a3d1-3d8601d191f4', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:59:57.758257 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:57.759778 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:57.767521 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:57.767973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:57.768767 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:57.769207 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:57.831137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:59:57.831553 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:59:57.832388 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:59:57.832793 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:59:57.833202 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:59:57.843816 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:57.844256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:57.845153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:57.845589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:57.863405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Getting quotas for project 65c173bb6e2e4edba095bbd06228bbc3. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:59:57.866674 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Getting quotas for user 256021e079304993a03de9232cba80e4 and project 65c173bb6e2e4edba095bbd06228bbc3. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:59:57.878171 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:59:57.880532 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:59:57.942458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2a6f3e85-8e76-4cad-8ab2-34f42ea17381 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552417 Jan 28 00:59:57.942833 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:57.943265 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 153/277] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 00:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:59:57.962720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8f49d1a9-efe5-407f-b801-2348906c2ed3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:57.964105 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8f49d1a9-efe5-407f-b801-2348906c2ed3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:57.964383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:57.967858 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:57.970498 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-223ecb76-e050-4772-80ea-b89a83bf4ca4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.216743 Jan 28 00:59:57.984352 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 125/278] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:57 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:58.061833 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8f49d1a9-efe5-407f-b801-2348906c2ed3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:58.070776 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8f49d1a9-efe5-407f-b801-2348906c2ed3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1214 microversion: 2.1 time: 0.121564 Jan 28 00:59:58.071844 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 154/279] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:57 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:59.004303 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:59.004939 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:59.011274 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:59.011727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:59.012508 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:59.013519 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:59.090043 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-59ec8daf-7005-43bf-b517-41ed4751a71c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:59.090646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-59ec8daf-7005-43bf-b517-41ed4751a71c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:59.097158 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59ec8daf-7005-43bf-b517-41ed4751a71c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:59.097602 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59ec8daf-7005-43bf-b517-41ed4751a71c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:59.098374 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59ec8daf-7005-43bf-b517-41ed4751a71c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:59.098809 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59ec8daf-7005-43bf-b517-41ed4751a71c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:59.147337 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:59.155145 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:59.156660 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:59.157821 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-681ac9b2-f684-474e-9170-840b86e0b569 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.157308 Jan 28 00:59:59.158386 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 126/280] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:58 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:59.160991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-59ec8daf-7005-43bf-b517-41ed4751a71c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:59.168739 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-59ec8daf-7005-43bf-b517-41ed4751a71c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1266 microversion: 2.1 time: 0.082444 Jan 28 00:59:59.170263 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 155/281] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:59 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:59.790524 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-742ac928-1a07-48bc-880e-a8dfec36aafa tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c69fc95-58ab-49d1-9d0c-70f1ae9b2a59", "device": "/dev/sdb"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:59.792167 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-742ac928-1a07-48bc-880e-a8dfec36aafa tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:59.798759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-742ac928-1a07-48bc-880e-a8dfec36aafa tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:59.799496 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-742ac928-1a07-48bc-880e-a8dfec36aafa tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:59.801048 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-742ac928-1a07-48bc-880e-a8dfec36aafa tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:59.801928 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-742ac928-1a07-48bc-880e-a8dfec36aafa tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:00.165827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-742ac928-1a07-48bc-880e-a8dfec36aafa tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "POST /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379294 Jan 28 01:00:00.167309 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 127/282] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 00:59:59 2022] POST /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:00.176197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:00.177583 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:00.192068 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-aefd8b31-b2d8-424f-86f3-f4a51ef58d7c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:00.193251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-aefd8b31-b2d8-424f-86f3-f4a51ef58d7c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:00.196505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:00.197743 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:00.199673 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:00.202242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:00.206456 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-aefd8b31-b2d8-424f-86f3-f4a51ef58d7c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:00.207047 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-aefd8b31-b2d8-424f-86f3-f4a51ef58d7c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:00.208016 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-aefd8b31-b2d8-424f-86f3-f4a51ef58d7c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:00.208523 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-aefd8b31-b2d8-424f-86f3-f4a51ef58d7c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:00.402762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:00.413541 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:00.415667 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:00.416909 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3e59b04e-9de8-487f-9cb5-90e654c45850 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.245382 Jan 28 01:00:00.417832 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 156/283] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:00 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:00.476263 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-aefd8b31-b2d8-424f-86f3-f4a51ef58d7c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:00.489241 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-aefd8b31-b2d8-424f-86f3-f4a51ef58d7c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.307233 Jan 28 01:00:00.490602 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 128/284] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:00 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:00.974727 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-972ccb91-fd72-4aa3-841a-843b0db57e88 req-9f430447-8a0b-4520-bfc0-1faaf1d8addf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93eab28c-4c8f-4e2b-94a5-17230141040a", "tag": "5f980b28-87a1-4775-8cd3-bd5038fc9cf1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:00.976671 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:00.976671 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:00:00.987344 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-972ccb91-fd72-4aa3-841a-843b0db57e88 req-9f430447-8a0b-4520-bfc0-1faaf1d8addf service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:00.988196 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-972ccb91-fd72-4aa3-841a-843b0db57e88 req-9f430447-8a0b-4520-bfc0-1faaf1d8addf service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:00.999808 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-972ccb91-fd72-4aa3-841a-843b0db57e88 req-9f430447-8a0b-4520-bfc0-1faaf1d8addf service nova] Creating event network-changed:5f980b28-87a1-4775-8cd3-bd5038fc9cf1 for instance 93eab28c-4c8f-4e2b-94a5-17230141040a on hv-cinder-81689 Jan 28 01:00:01.005153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-972ccb91-fd72-4aa3-841a-843b0db57e88 req-9f430447-8a0b-4520-bfc0-1faaf1d8addf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034158 Jan 28 01:00:01.006026 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 157/285] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:00:01.437065 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:01.437672 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:01.458786 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:01.459502 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:01.465191 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:01.465727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:01.508229 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-89ad14a3-d91d-4ebf-b1c4-332cf76b210c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:01.508972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-89ad14a3-d91d-4ebf-b1c4-332cf76b210c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:01.515747 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-89ad14a3-d91d-4ebf-b1c4-332cf76b210c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:01.516202 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-89ad14a3-d91d-4ebf-b1c4-332cf76b210c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:01.517000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-89ad14a3-d91d-4ebf-b1c4-332cf76b210c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:01.517459 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-89ad14a3-d91d-4ebf-b1c4-332cf76b210c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:01.667321 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-89ad14a3-d91d-4ebf-b1c4-332cf76b210c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:01.675153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-89ad14a3-d91d-4ebf-b1c4-332cf76b210c tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.171539 Jan 28 01:00:01.675732 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 158/286] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:01 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:01.745810 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:01.754068 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:01.755643 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:01.756836 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5fc777ed-6dad-425b-9722-ce5cb602545f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1744 microversion: 2.20 time: 0.324349 Jan 28 01:00:01.757395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 129/287] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:01 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1744 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:02.634128 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2a1c348b-3416-4fce-b553-311bac470e36 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:02.635163 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2a1c348b-3416-4fce-b553-311bac470e36 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:02.649526 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a1c348b-3416-4fce-b553-311bac470e36 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:02.651858 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a1c348b-3416-4fce-b553-311bac470e36 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:02.653305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a1c348b-3416-4fce-b553-311bac470e36 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:02.655434 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2a1c348b-3416-4fce-b553-311bac470e36 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:02.681296 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-2a1c348b-3416-4fce-b553-311bac470e36 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'flavor' on Instance uuid 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:00:02.692519 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d96ef764-0806-471f-9c49-1d14ddd429f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:02.693749 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d96ef764-0806-471f-9c49-1d14ddd429f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:02.702268 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d96ef764-0806-471f-9c49-1d14ddd429f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:02.703089 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d96ef764-0806-471f-9c49-1d14ddd429f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:02.704078 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d96ef764-0806-471f-9c49-1d14ddd429f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:02.704866 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d96ef764-0806-471f-9c49-1d14ddd429f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:02.860417 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2a1c348b-3416-4fce-b553-311bac470e36 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/action" status: 200 len: 32 microversion: 2.1 time: 0.230903 Jan 28 01:00:02.863180 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 159/288] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:00:02 2022] POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:00:02.869310 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:02.870280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:02.876068 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d96ef764-0806-471f-9c49-1d14ddd429f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:02.876557 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:02.877007 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:02.877877 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:02.878321 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:02.894642 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d96ef764-0806-471f-9c49-1d14ddd429f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.206613 Jan 28 01:00:02.896893 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 130/289] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:02 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:02.902774 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8c2034b4-19d4-4290-97d3-aaf773db4527 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:02.903536 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8c2034b4-19d4-4290-97d3-aaf773db4527 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:02.910373 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8c2034b4-19d4-4290-97d3-aaf773db4527 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:02.910818 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8c2034b4-19d4-4290-97d3-aaf773db4527 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:02.911700 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8c2034b4-19d4-4290-97d3-aaf773db4527 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:02.912129 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8c2034b4-19d4-4290-97d3-aaf773db4527 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:03.104573 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:03.115590 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:03.123454 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:03.125881 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5e908f65-9264-4d3e-8f86-b0634160f52f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1744 microversion: 2.20 time: 0.261137 Jan 28 01:00:03.130013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 160/290] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:02 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1744 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:03.195680 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8c2034b4-19d4-4290-97d3-aaf773db4527 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:03.209162 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8c2034b4-19d4-4290-97d3-aaf773db4527 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.310404 Jan 28 01:00:03.221587 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 131/291] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:02 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:03.913236 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3e06aa59-3de6-401e-9fee-373eb3b024ea tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:03.913854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3e06aa59-3de6-401e-9fee-373eb3b024ea tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:03.921420 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e06aa59-3de6-401e-9fee-373eb3b024ea tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:03.921869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e06aa59-3de6-401e-9fee-373eb3b024ea tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:03.922658 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e06aa59-3de6-401e-9fee-373eb3b024ea tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:03.923128 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3e06aa59-3de6-401e-9fee-373eb3b024ea tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:04.064209 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3e06aa59-3de6-401e-9fee-373eb3b024ea tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:04.073234 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3e06aa59-3de6-401e-9fee-373eb3b024ea tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.163458 Jan 28 01:00:04.074034 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 161/292] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:03 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:04.148402 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:04.148980 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:04.155797 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:04.156239 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:04.157009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:04.157438 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:04.228595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6fde05e7-78eb-491b-8e01-cd7331fdc721 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:04.229317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6fde05e7-78eb-491b-8e01-cd7331fdc721 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:04.235922 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6fde05e7-78eb-491b-8e01-cd7331fdc721 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:04.236371 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6fde05e7-78eb-491b-8e01-cd7331fdc721 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:04.237161 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6fde05e7-78eb-491b-8e01-cd7331fdc721 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:04.237593 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6fde05e7-78eb-491b-8e01-cd7331fdc721 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:04.300768 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:04.308747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:04.310264 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:04.311457 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-692ce335-0811-4354-b1be-2195c215c9e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1744 microversion: 2.20 time: 0.167035 Jan 28 01:00:04.312015 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 132/293] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:04 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:04.369307 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6fde05e7-78eb-491b-8e01-cd7331fdc721 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:04.377047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6fde05e7-78eb-491b-8e01-cd7331fdc721 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.152341 Jan 28 01:00:04.377609 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 162/294] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:04 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:05.089562 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ed786a13-3d72-4a66-b093-55d61d678cd3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:05.090171 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ed786a13-3d72-4a66-b093-55d61d678cd3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:05.096903 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ed786a13-3d72-4a66-b093-55d61d678cd3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:05.097353 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ed786a13-3d72-4a66-b093-55d61d678cd3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:05.098121 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ed786a13-3d72-4a66-b093-55d61d678cd3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:05.098676 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ed786a13-3d72-4a66-b093-55d61d678cd3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:05.229994 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ed786a13-3d72-4a66-b093-55d61d678cd3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:05.238327 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ed786a13-3d72-4a66-b093-55d61d678cd3 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.152653 Jan 28 01:00:05.238910 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 133/295] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:05 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:05.329834 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:05.330440 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:05.336784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:05.337265 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:05.338041 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:05.338472 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:05.393892 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ddb294c9-2c0d-43a2-95d3-b29ff32b2baf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:05.394418 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ddb294c9-2c0d-43a2-95d3-b29ff32b2baf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:05.400587 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddb294c9-2c0d-43a2-95d3-b29ff32b2baf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:05.401042 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddb294c9-2c0d-43a2-95d3-b29ff32b2baf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:05.401830 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddb294c9-2c0d-43a2-95d3-b29ff32b2baf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:05.402274 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddb294c9-2c0d-43a2-95d3-b29ff32b2baf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:05.472458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:05.480601 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:05.482141 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:05.483336 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-efcaf452-58a5-4147-8910-246476045c9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1744 microversion: 2.20 time: 0.157254 Jan 28 01:00:05.483899 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 163/296] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:05 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:05.529287 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ddb294c9-2c0d-43a2-95d3-b29ff32b2baf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:05.537028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ddb294c9-2c0d-43a2-95d3-b29ff32b2baf tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.146907 Jan 28 01:00:05.537583 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 134/297] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:05 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:06.255387 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fc69e52e-d552-47f7-97a1-3a052448f4cf tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:06.255920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fc69e52e-d552-47f7-97a1-3a052448f4cf tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:06.262008 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc69e52e-d552-47f7-97a1-3a052448f4cf tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:06.262462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc69e52e-d552-47f7-97a1-3a052448f4cf tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:06.263287 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc69e52e-d552-47f7-97a1-3a052448f4cf tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:06.263727 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc69e52e-d552-47f7-97a1-3a052448f4cf tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:06.405760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fc69e52e-d552-47f7-97a1-3a052448f4cf tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:06.414587 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fc69e52e-d552-47f7-97a1-3a052448f4cf tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.162524 Jan 28 01:00:06.415347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 164/298] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:06 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:06.501961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:06.502562 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:06.508973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:06.509418 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:06.510303 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:06.510747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:06.557505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d5c33c18-b373-4448-b3eb-cf83ec09cc1f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:06.558514 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d5c33c18-b373-4448-b3eb-cf83ec09cc1f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:06.570246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d5c33c18-b373-4448-b3eb-cf83ec09cc1f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:06.571167 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d5c33c18-b373-4448-b3eb-cf83ec09cc1f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:06.572712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d5c33c18-b373-4448-b3eb-cf83ec09cc1f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:06.573398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d5c33c18-b373-4448-b3eb-cf83ec09cc1f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:06.672873 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:06.682213 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:06.684009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:06.685407 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5529da16-859b-4f98-a964-368a5b811392 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.187314 Jan 28 01:00:06.686129 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 135/299] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:06 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:06.755125 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d5c33c18-b373-4448-b3eb-cf83ec09cc1f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:06.769431 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d5c33c18-b373-4448-b3eb-cf83ec09cc1f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.214980 Jan 28 01:00:06.776137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 165/300] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:06 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:07.437376 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c791f9e5-74f3-46f3-84bb-eba28d63e8c9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:07.438734 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c791f9e5-74f3-46f3-84bb-eba28d63e8c9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:07.451617 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c791f9e5-74f3-46f3-84bb-eba28d63e8c9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:07.452360 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c791f9e5-74f3-46f3-84bb-eba28d63e8c9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:07.453343 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c791f9e5-74f3-46f3-84bb-eba28d63e8c9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:07.454821 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c791f9e5-74f3-46f3-84bb-eba28d63e8c9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:07.633982 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c791f9e5-74f3-46f3-84bb-eba28d63e8c9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:07.651518 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c791f9e5-74f3-46f3-84bb-eba28d63e8c9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.220154 Jan 28 01:00:07.652834 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 136/301] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:07 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:07.705313 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:07.706769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:07.713862 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:07.714617 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:07.716317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:07.716866 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:07.787505 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ffc96a1f-7db2-4324-a4d3-fdd255079d3d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:07.788589 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ffc96a1f-7db2-4324-a4d3-fdd255079d3d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:07.795230 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ffc96a1f-7db2-4324-a4d3-fdd255079d3d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:07.799518 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ffc96a1f-7db2-4324-a4d3-fdd255079d3d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:07.800854 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ffc96a1f-7db2-4324-a4d3-fdd255079d3d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:07.801680 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ffc96a1f-7db2-4324-a4d3-fdd255079d3d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:07.890436 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:07.900303 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:07.902444 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:07.904442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d7b25648-be93-4a75-a368-11db3550203c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.203968 Jan 28 01:00:07.916986 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 166/302] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:07 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:07.986698 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ffc96a1f-7db2-4324-a4d3-fdd255079d3d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:08.001168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ffc96a1f-7db2-4324-a4d3-fdd255079d3d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.217548 Jan 28 01:00:08.002512 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 137/303] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:07 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:08.676197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-040e29da-00f3-449f-98bb-86f4fac4e647 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:08.677054 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-040e29da-00f3-449f-98bb-86f4fac4e647 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:08.691262 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-040e29da-00f3-449f-98bb-86f4fac4e647 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:08.692401 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-040e29da-00f3-449f-98bb-86f4fac4e647 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:08.693712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-040e29da-00f3-449f-98bb-86f4fac4e647 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:08.694436 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-040e29da-00f3-449f-98bb-86f4fac4e647 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:08.885857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-040e29da-00f3-449f-98bb-86f4fac4e647 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:08.901912 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-040e29da-00f3-449f-98bb-86f4fac4e647 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.233764 Jan 28 01:00:08.902764 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 167/304] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:08 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:08.927145 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:08.928784 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:08.935887 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:08.936627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:08.938178 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:08.939148 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:09.023410 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-15924c82-52d7-426d-af15-8085c2bdddf7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:09.024041 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-15924c82-52d7-426d-af15-8085c2bdddf7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:09.040478 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-15924c82-52d7-426d-af15-8085c2bdddf7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:09.040941 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-15924c82-52d7-426d-af15-8085c2bdddf7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:09.041758 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-15924c82-52d7-426d-af15-8085c2bdddf7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:09.042197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-15924c82-52d7-426d-af15-8085c2bdddf7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:09.136652 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:09.148845 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:09.152213 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:09.155242 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-17d27561-15ee-4413-9206-46511dd9c675 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.233216 Jan 28 01:00:09.156520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 138/305] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:08 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:09.253955 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-15924c82-52d7-426d-af15-8085c2bdddf7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:09.265183 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-15924c82-52d7-426d-af15-8085c2bdddf7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.247576 Jan 28 01:00:09.266085 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 168/306] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:09 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:09.919415 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-01035d9e-5974-44ca-a518-c4f4c7f7f6f5 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:09.919991 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-01035d9e-5974-44ca-a518-c4f4c7f7f6f5 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:09.926477 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-01035d9e-5974-44ca-a518-c4f4c7f7f6f5 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:09.927938 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-01035d9e-5974-44ca-a518-c4f4c7f7f6f5 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:09.929496 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-01035d9e-5974-44ca-a518-c4f4c7f7f6f5 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:09.929984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-01035d9e-5974-44ca-a518-c4f4c7f7f6f5 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:10.086863 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-01035d9e-5974-44ca-a518-c4f4c7f7f6f5 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:10.095732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-01035d9e-5974-44ca-a518-c4f4c7f7f6f5 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.179999 Jan 28 01:00:10.096746 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 139/307] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:09 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:10.174691 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:10.176468 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:10.187494 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:10.188213 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:10.189213 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:10.189653 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:10.291774 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-663251f7-63cb-4ca7-ae29-e5962fbdf322 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:10.292394 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-663251f7-63cb-4ca7-ae29-e5962fbdf322 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:10.300270 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-663251f7-63cb-4ca7-ae29-e5962fbdf322 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:10.301400 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-663251f7-63cb-4ca7-ae29-e5962fbdf322 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:10.302527 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-663251f7-63cb-4ca7-ae29-e5962fbdf322 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:10.302983 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-663251f7-63cb-4ca7-ae29-e5962fbdf322 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:10.376163 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:10.386822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:10.388933 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:10.390113 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1ec71acf-d230-423d-ad2e-9af669898ab4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.219471 Jan 28 01:00:10.390685 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 169/308] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:10 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:10.478554 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-663251f7-63cb-4ca7-ae29-e5962fbdf322 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:10.488651 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-663251f7-63cb-4ca7-ae29-e5962fbdf322 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.202587 Jan 28 01:00:10.506012 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 140/309] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:10 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:10.662059 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-184d657a-61d6-4984-a364-8e936c502ce5 req-0b1afbff-db04-4680-8bf2-4042956b6679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ab5025-62f7-40d2-b976-95ed4c6f0499", "name": "network-vif-plugged", "status": "completed", "tag": "4018b024-2307-4179-b2ef-10369aaee53c"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:10.665510 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:10.665510 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:00:10.680867 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-184d657a-61d6-4984-a364-8e936c502ce5 req-0b1afbff-db04-4680-8bf2-4042956b6679 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:10.681713 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-184d657a-61d6-4984-a364-8e936c502ce5 req-0b1afbff-db04-4680-8bf2-4042956b6679 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:10.700619 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-184d657a-61d6-4984-a364-8e936c502ce5 req-0b1afbff-db04-4680-8bf2-4042956b6679 service nova] Creating event network-vif-plugged:4018b024-2307-4179-b2ef-10369aaee53c for instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 on hv-cinder-81689 Jan 28 01:00:10.706090 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-184d657a-61d6-4984-a364-8e936c502ce5 req-0b1afbff-db04-4680-8bf2-4042956b6679 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051572 Jan 28 01:00:10.707148 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 170/310] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:11.113100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-df982145-1fa0-4f5c-a11e-3d53e89f6bdd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:11.115284 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-df982145-1fa0-4f5c-a11e-3d53e89f6bdd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:11.154166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-df982145-1fa0-4f5c-a11e-3d53e89f6bdd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:11.175287 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-df982145-1fa0-4f5c-a11e-3d53e89f6bdd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:11.177822 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-df982145-1fa0-4f5c-a11e-3d53e89f6bdd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:11.180168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-df982145-1fa0-4f5c-a11e-3d53e89f6bdd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:11.409903 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:11.411984 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:11.455085 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:11.456410 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:11.459687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:11.462177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:11.511760 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-df982145-1fa0-4f5c-a11e-3d53e89f6bdd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:11.521947 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-df982145-1fa0-4f5c-a11e-3d53e89f6bdd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.412388 Jan 28 01:00:11.523429 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 141/311] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:11 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:11.542602 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9a6cf214-7c60-49b3-9c1f-fc65f4ad429c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:11.545402 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9a6cf214-7c60-49b3-9c1f-fc65f4ad429c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:11.560098 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9a6cf214-7c60-49b3-9c1f-fc65f4ad429c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:11.562393 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9a6cf214-7c60-49b3-9c1f-fc65f4ad429c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:11.563563 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9a6cf214-7c60-49b3-9c1f-fc65f4ad429c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:11.565104 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9a6cf214-7c60-49b3-9c1f-fc65f4ad429c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:11.795654 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-9a6cf214-7c60-49b3-9c1f-fc65f4ad429c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:11.818754 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9a6cf214-7c60-49b3-9c1f-fc65f4ad429c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.291349 Jan 28 01:00:11.820919 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 142/312] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:11 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:11.840382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:11.852587 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:11.854646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:11.856962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2de4c302-ad39-4ceb-8042-938b317121e6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.451223 Jan 28 01:00:11.857606 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 171/313] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:11 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:12.557502 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cb4541b9-95a4-4c06-807c-395bc19bf9fa tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:12.559009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cb4541b9-95a4-4c06-807c-395bc19bf9fa tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:12.568639 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb4541b9-95a4-4c06-807c-395bc19bf9fa tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:12.569401 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb4541b9-95a4-4c06-807c-395bc19bf9fa tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:12.570294 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb4541b9-95a4-4c06-807c-395bc19bf9fa tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:12.570742 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb4541b9-95a4-4c06-807c-395bc19bf9fa tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:12.799841 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-cb4541b9-95a4-4c06-807c-395bc19bf9fa tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:12.807456 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cb4541b9-95a4-4c06-807c-395bc19bf9fa tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.269926 Jan 28 01:00:12.812523 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 143/314] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:12 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:12.837421 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3b3f7a34-4ecf-4ebd-830f-0e43768a9abd tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:12.838069 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3b3f7a34-4ecf-4ebd-830f-0e43768a9abd tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:12.848042 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b3f7a34-4ecf-4ebd-830f-0e43768a9abd tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:12.848939 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b3f7a34-4ecf-4ebd-830f-0e43768a9abd tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:12.849829 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b3f7a34-4ecf-4ebd-830f-0e43768a9abd tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:12.850489 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b3f7a34-4ecf-4ebd-830f-0e43768a9abd tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:12.876011 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:12.876816 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:12.883769 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:12.886803 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:12.886803 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:12.887911 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:13.007308 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3b3f7a34-4ecf-4ebd-830f-0e43768a9abd tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:13.018282 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3b3f7a34-4ecf-4ebd-830f-0e43768a9abd tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.184093 Jan 28 01:00:13.019187 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 172/315] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:12 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:13.080789 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:13.092439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:13.093991 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:13.095228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-352e62a1-7ddd-44ac-9dec-38a37e34a618 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.224052 Jan 28 01:00:13.096055 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 144/316] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:12 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:13.827903 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-469fa465-978f-4be3-b650-e8d20ba7ebb8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:13.828653 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-469fa465-978f-4be3-b650-e8d20ba7ebb8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:13.834866 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-469fa465-978f-4be3-b650-e8d20ba7ebb8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:13.835345 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-469fa465-978f-4be3-b650-e8d20ba7ebb8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:13.836133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-469fa465-978f-4be3-b650-e8d20ba7ebb8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:13.836567 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-469fa465-978f-4be3-b650-e8d20ba7ebb8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:13.989102 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-469fa465-978f-4be3-b650-e8d20ba7ebb8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:14.001640 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-469fa465-978f-4be3-b650-e8d20ba7ebb8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.177251 Jan 28 01:00:14.002582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 173/317] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:13 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:14.035442 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-444487a7-d568-483b-9320-ad3a875a717b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:14.036876 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-444487a7-d568-483b-9320-ad3a875a717b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:14.044577 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-444487a7-d568-483b-9320-ad3a875a717b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:14.045312 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-444487a7-d568-483b-9320-ad3a875a717b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:14.046316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-444487a7-d568-483b-9320-ad3a875a717b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:14.046759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-444487a7-d568-483b-9320-ad3a875a717b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:14.114022 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:14.114631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:14.121427 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:14.121918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:14.123052 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:14.123672 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:14.218087 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-444487a7-d568-483b-9320-ad3a875a717b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:14.231726 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-444487a7-d568-483b-9320-ad3a875a717b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.198989 Jan 28 01:00:14.235028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 145/318] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:14 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:14.299939 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:14.308699 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:14.313651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:14.313651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f85363f3-7e33-43ff-acbe-48498e6ba3de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.202150 Jan 28 01:00:14.325660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 174/319] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:14 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:15.021737 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d5e6227a-897d-4ae1-b2f4-19484d1433d9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:15.023091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d5e6227a-897d-4ae1-b2f4-19484d1433d9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:15.030498 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d5e6227a-897d-4ae1-b2f4-19484d1433d9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:15.031134 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d5e6227a-897d-4ae1-b2f4-19484d1433d9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:15.032114 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d5e6227a-897d-4ae1-b2f4-19484d1433d9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:15.033127 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d5e6227a-897d-4ae1-b2f4-19484d1433d9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:15.180835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d5e6227a-897d-4ae1-b2f4-19484d1433d9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:15.189600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d5e6227a-897d-4ae1-b2f4-19484d1433d9 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.171650 Jan 28 01:00:15.190374 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 146/320] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:15 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:15.251333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e6da557b-c1fb-476e-99c8-9df27f4c26a9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:15.251964 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e6da557b-c1fb-476e-99c8-9df27f4c26a9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:15.259400 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e6da557b-c1fb-476e-99c8-9df27f4c26a9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:15.260294 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e6da557b-c1fb-476e-99c8-9df27f4c26a9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:15.261160 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e6da557b-c1fb-476e-99c8-9df27f4c26a9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:15.261695 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e6da557b-c1fb-476e-99c8-9df27f4c26a9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:15.333750 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:15.334680 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:15.342210 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:15.342672 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:15.343526 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:15.344199 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:15.443176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e6da557b-c1fb-476e-99c8-9df27f4c26a9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:15.459110 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e6da557b-c1fb-476e-99c8-9df27f4c26a9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.212495 Jan 28 01:00:15.470948 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 175/321] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:15 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:15.547849 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:15.556666 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:15.558186 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:15.559401 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e42c2a8c-acf4-45c3-ac8c-9e48b42637d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.229591 Jan 28 01:00:15.559966 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 147/322] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:15 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:16.212804 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-007f611a-3409-4684-967c-35d96960e352 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:16.214582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-007f611a-3409-4684-967c-35d96960e352 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:16.224820 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-007f611a-3409-4684-967c-35d96960e352 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:16.225661 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-007f611a-3409-4684-967c-35d96960e352 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:16.226692 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-007f611a-3409-4684-967c-35d96960e352 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:16.227623 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-007f611a-3409-4684-967c-35d96960e352 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:16.442019 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-007f611a-3409-4684-967c-35d96960e352 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:16.452753 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-007f611a-3409-4684-967c-35d96960e352 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.247023 Jan 28 01:00:16.455972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 176/323] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:16 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:16.478184 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b5998b82-a8be-4d6c-9c7e-bd88dfeacafb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:16.479380 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b5998b82-a8be-4d6c-9c7e-bd88dfeacafb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:16.489465 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b5998b82-a8be-4d6c-9c7e-bd88dfeacafb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:16.489993 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b5998b82-a8be-4d6c-9c7e-bd88dfeacafb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:16.490793 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b5998b82-a8be-4d6c-9c7e-bd88dfeacafb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:16.491264 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b5998b82-a8be-4d6c-9c7e-bd88dfeacafb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:16.580292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:16.580936 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:16.587303 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:16.587854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:16.589393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:16.590477 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:16.658507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b5998b82-a8be-4d6c-9c7e-bd88dfeacafb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:16.666547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b5998b82-a8be-4d6c-9c7e-bd88dfeacafb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.193665 Jan 28 01:00:16.667162 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 148/324] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:16 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:16.742910 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:16.751973 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:16.753533 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:16.755035 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f6484eae-88cc-4a5a-8a97-d41782fbf3e4 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.181241 Jan 28 01:00:16.755603 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 177/325] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:16 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:17.476783 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8d421287-62ae-48d7-80cb-75ec44bf0e78 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:17.477389 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8d421287-62ae-48d7-80cb-75ec44bf0e78 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:17.484080 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d421287-62ae-48d7-80cb-75ec44bf0e78 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.484690 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d421287-62ae-48d7-80cb-75ec44bf0e78 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.485301 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d421287-62ae-48d7-80cb-75ec44bf0e78 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.485736 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d421287-62ae-48d7-80cb-75ec44bf0e78 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.618977 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8d421287-62ae-48d7-80cb-75ec44bf0e78 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:17.627173 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8d421287-62ae-48d7-80cb-75ec44bf0e78 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.154080 Jan 28 01:00:17.627753 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 149/326] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:17 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:17.683843 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3bcdcbbb-43fe-454b-b8f6-ff17a4455315 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:17.684504 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3bcdcbbb-43fe-454b-b8f6-ff17a4455315 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:17.691150 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bcdcbbb-43fe-454b-b8f6-ff17a4455315 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.691596 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bcdcbbb-43fe-454b-b8f6-ff17a4455315 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.692391 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bcdcbbb-43fe-454b-b8f6-ff17a4455315 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.692830 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bcdcbbb-43fe-454b-b8f6-ff17a4455315 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.773837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:17.774531 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:17.781558 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.782112 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.783102 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.783549 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.839024 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3bcdcbbb-43fe-454b-b8f6-ff17a4455315 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:17.849885 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3bcdcbbb-43fe-454b-b8f6-ff17a4455315 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.169664 Jan 28 01:00:17.850481 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 178/327] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:17 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:17.931807 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:17.940950 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:17.942451 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:17.943641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7cdc9fb5-cc35-4137-aabf-eb13d81e683e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1739 microversion: 2.20 time: 0.173964 Jan 28 01:00:17.944203 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 150/328] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:17 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:18.509336 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-5bff2a09-07be-43e2-8ac3-b5805acb240b req-5fc4702f-281f-4a44-b1db-2d9e41983b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93eab28c-4c8f-4e2b-94a5-17230141040a", "name": "network-vif-plugged", "status": "completed", "tag": "5f980b28-87a1-4775-8cd3-bd5038fc9cf1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:18.511718 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:18.511718 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:00:18.519782 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-5bff2a09-07be-43e2-8ac3-b5805acb240b req-5fc4702f-281f-4a44-b1db-2d9e41983b17 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.520232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-5bff2a09-07be-43e2-8ac3-b5805acb240b req-5fc4702f-281f-4a44-b1db-2d9e41983b17 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.534176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-5bff2a09-07be-43e2-8ac3-b5805acb240b req-5fc4702f-281f-4a44-b1db-2d9e41983b17 service nova] Creating event network-vif-plugged:5f980b28-87a1-4775-8cd3-bd5038fc9cf1 for instance 93eab28c-4c8f-4e2b-94a5-17230141040a on hv-cinder-81689 Jan 28 01:00:18.540569 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-5bff2a09-07be-43e2-8ac3-b5805acb240b req-5fc4702f-281f-4a44-b1db-2d9e41983b17 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035939 Jan 28 01:00:18.541699 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 179/329] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:18.645322 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f3141aa6-f0aa-47d1-862f-94e8c5af4b8a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:18.647801 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f3141aa6-f0aa-47d1-862f-94e8c5af4b8a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:18.655514 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3141aa6-f0aa-47d1-862f-94e8c5af4b8a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.656061 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3141aa6-f0aa-47d1-862f-94e8c5af4b8a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.656804 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3141aa6-f0aa-47d1-862f-94e8c5af4b8a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.657166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3141aa6-f0aa-47d1-862f-94e8c5af4b8a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.810062 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f3141aa6-f0aa-47d1-862f-94e8c5af4b8a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:18.818349 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f3141aa6-f0aa-47d1-862f-94e8c5af4b8a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.177371 Jan 28 01:00:18.818975 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 151/330] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:18 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:18.871989 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-cbde8092-948c-4282-9d0c-790cdb182f9e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:18.873522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-cbde8092-948c-4282-9d0c-790cdb182f9e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:18.886783 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cbde8092-948c-4282-9d0c-790cdb182f9e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.888161 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cbde8092-948c-4282-9d0c-790cdb182f9e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.889660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cbde8092-948c-4282-9d0c-790cdb182f9e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.895429 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cbde8092-948c-4282-9d0c-790cdb182f9e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.963970 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:18.964796 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:18.978685 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.979190 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.983445 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.983957 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:19.103904 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-cbde8092-948c-4282-9d0c-790cdb182f9e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:19.114639 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-cbde8092-948c-4282-9d0c-790cdb182f9e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.250050 Jan 28 01:00:19.126748 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 180/331] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:18 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:19.182203 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:19.192026 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:19.193527 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:19.194683 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0a27d867-d88b-4432-af5c-a611a39111de tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1721 microversion: 2.20 time: 0.236321 Jan 28 01:00:19.195310 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 152/332] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:18 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:19.836178 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-457fcb5c-68eb-4103-a4b9-a7e58af21c48 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:19.836852 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-457fcb5c-68eb-4103-a4b9-a7e58af21c48 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:19.843698 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-457fcb5c-68eb-4103-a4b9-a7e58af21c48 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:19.844198 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-457fcb5c-68eb-4103-a4b9-a7e58af21c48 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:19.845044 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-457fcb5c-68eb-4103-a4b9-a7e58af21c48 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:19.845571 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-457fcb5c-68eb-4103-a4b9-a7e58af21c48 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:19.990447 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-457fcb5c-68eb-4103-a4b9-a7e58af21c48 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:19.999483 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-457fcb5c-68eb-4103-a4b9-a7e58af21c48 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.167332 Jan 28 01:00:20.000058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 181/333] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:19 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:20.134407 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-35d83393-2d9a-446c-906f-e0d938c0abdc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:20.135197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-35d83393-2d9a-446c-906f-e0d938c0abdc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:20.144269 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35d83393-2d9a-446c-906f-e0d938c0abdc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:20.144878 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35d83393-2d9a-446c-906f-e0d938c0abdc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:20.146075 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35d83393-2d9a-446c-906f-e0d938c0abdc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:20.146924 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35d83393-2d9a-446c-906f-e0d938c0abdc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:20.213654 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:20.214690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:20.227309 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:20.227905 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:20.228908 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:20.229480 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:20.351965 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-35d83393-2d9a-446c-906f-e0d938c0abdc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:20.364507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-35d83393-2d9a-446c-906f-e0d938c0abdc tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.234744 Jan 28 01:00:20.365678 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 153/334] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:20 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:20.441893 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:20.451553 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:20.454918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:20.454918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4ce559de-9e6d-4d5b-ac8f-82820f0442dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1721 microversion: 2.20 time: 0.244254 Jan 28 01:00:20.454918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 182/335] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:20 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:21.016106 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7bc27ec9-ac2d-4ed4-aff8-2acc069a5e73 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:21.016626 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7bc27ec9-ac2d-4ed4-aff8-2acc069a5e73 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:21.022777 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7bc27ec9-ac2d-4ed4-aff8-2acc069a5e73 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.023254 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7bc27ec9-ac2d-4ed4-aff8-2acc069a5e73 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.024024 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7bc27ec9-ac2d-4ed4-aff8-2acc069a5e73 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.024461 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7bc27ec9-ac2d-4ed4-aff8-2acc069a5e73 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.163275 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7bc27ec9-ac2d-4ed4-aff8-2acc069a5e73 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:21.171277 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7bc27ec9-ac2d-4ed4-aff8-2acc069a5e73 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.158853 Jan 28 01:00:21.171834 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 154/336] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:21 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:21.388879 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-93332b2c-60a7-4d0b-a339-b0e9f9b02759 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:21.389689 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-93332b2c-60a7-4d0b-a339-b0e9f9b02759 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:21.398486 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-93332b2c-60a7-4d0b-a339-b0e9f9b02759 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.399179 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-93332b2c-60a7-4d0b-a339-b0e9f9b02759 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.400199 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-93332b2c-60a7-4d0b-a339-b0e9f9b02759 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.400837 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-93332b2c-60a7-4d0b-a339-b0e9f9b02759 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.472721 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:21.473479 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:21.480383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.480986 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.482624 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.483329 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.562738 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-93332b2c-60a7-4d0b-a339-b0e9f9b02759 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:21.575593 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-93332b2c-60a7-4d0b-a339-b0e9f9b02759 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.190176 Jan 28 01:00:21.576629 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 183/337] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:21 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:21.633997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:21.642194 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:21.643996 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:21.645174 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a726df32-c2c4-42a5-af4d-b46d719e7a93 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1721 microversion: 2.20 time: 0.176269 Jan 28 01:00:21.645803 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 155/338] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:21 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:22.188745 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-23ee29eb-dd96-498d-99dc-e20864c83cb6 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:22.189295 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-23ee29eb-dd96-498d-99dc-e20864c83cb6 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:22.196000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23ee29eb-dd96-498d-99dc-e20864c83cb6 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.196450 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23ee29eb-dd96-498d-99dc-e20864c83cb6 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.197242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23ee29eb-dd96-498d-99dc-e20864c83cb6 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.197677 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23ee29eb-dd96-498d-99dc-e20864c83cb6 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.348451 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-23ee29eb-dd96-498d-99dc-e20864c83cb6 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:22.357136 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-23ee29eb-dd96-498d-99dc-e20864c83cb6 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.172799 Jan 28 01:00:22.357937 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 184/339] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:22 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:22.594328 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-89cbc15b-415a-4233-afbf-936ac969af19 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:22.595578 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-89cbc15b-415a-4233-afbf-936ac969af19 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:22.604162 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-89cbc15b-415a-4233-afbf-936ac969af19 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.604162 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-89cbc15b-415a-4233-afbf-936ac969af19 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.604162 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-89cbc15b-415a-4233-afbf-936ac969af19 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.604632 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-89cbc15b-415a-4233-afbf-936ac969af19 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.667814 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:22.668871 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:22.697996 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.698370 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.699233 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.700419 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.879988 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-89cbc15b-415a-4233-afbf-936ac969af19 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:22.888679 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-89cbc15b-415a-4233-afbf-936ac969af19 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.299165 Jan 28 01:00:22.895654 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 156/340] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:22 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:22.912323 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-ee9ce63c-5c62-4cf5-a4d5-b03a4b525e7a req-238dcd8a-256c-444b-aa50-6f9230267ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ab5025-62f7-40d2-b976-95ed4c6f0499", "name": "network-vif-unplugged", "status": "completed", "tag": "4018b024-2307-4179-b2ef-10369aaee53c"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:22.912976 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:22.914424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:22.914424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:00:22.925133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:22.928517 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:22.930405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-651ba394-5f57-4fb3-9b78-32d11fb6aa01 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1721 microversion: 2.20 time: 0.269369 Jan 28 01:00:22.931546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 185/341] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:22 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:22.938653 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-ee9ce63c-5c62-4cf5-a4d5-b03a4b525e7a req-238dcd8a-256c-444b-aa50-6f9230267ce2 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.939692 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-ee9ce63c-5c62-4cf5-a4d5-b03a4b525e7a req-238dcd8a-256c-444b-aa50-6f9230267ce2 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.971728 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-ee9ce63c-5c62-4cf5-a4d5-b03a4b525e7a req-238dcd8a-256c-444b-aa50-6f9230267ce2 service nova] Creating event network-vif-unplugged:4018b024-2307-4179-b2ef-10369aaee53c for instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 on hv-cinder-81689 Jan 28 01:00:22.985820 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-ee9ce63c-5c62-4cf5-a4d5-b03a4b525e7a req-238dcd8a-256c-444b-aa50-6f9230267ce2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076413 Jan 28 01:00:22.985820 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 157/342] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:23.376807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-23ea4f3b-c327-4bf3-a9a9-840241446329 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:23.377452 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-23ea4f3b-c327-4bf3-a9a9-840241446329 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:23.384982 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23ea4f3b-c327-4bf3-a9a9-840241446329 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.385568 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23ea4f3b-c327-4bf3-a9a9-840241446329 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:23.386671 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23ea4f3b-c327-4bf3-a9a9-840241446329 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.387507 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23ea4f3b-c327-4bf3-a9a9-840241446329 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:23.558160 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-23ea4f3b-c327-4bf3-a9a9-840241446329 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:23.566447 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-23ea4f3b-c327-4bf3-a9a9-840241446329 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1314 microversion: 2.1 time: 0.195112 Jan 28 01:00:23.567062 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 186/343] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:23 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:23.914102 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f7229a9a-e127-4593-8c1c-fd9f46d15ae7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:23.914774 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f7229a9a-e127-4593-8c1c-fd9f46d15ae7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:23.921732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7229a9a-e127-4593-8c1c-fd9f46d15ae7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.922188 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7229a9a-e127-4593-8c1c-fd9f46d15ae7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:23.923015 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7229a9a-e127-4593-8c1c-fd9f46d15ae7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.923460 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7229a9a-e127-4593-8c1c-fd9f46d15ae7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:23.948944 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:23.950170 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:23.956915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.957366 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:23.958168 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.958612 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:24.063380 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f7229a9a-e127-4593-8c1c-fd9f46d15ae7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:24.071850 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f7229a9a-e127-4593-8c1c-fd9f46d15ae7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.162159 Jan 28 01:00:24.072225 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 158/344] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:23 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:24.117041 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:24.125426 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:24.127078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:24.128242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2786383a-b8ef-4b2a-837a-a74dbb800f7b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1721 microversion: 2.20 time: 0.183022 Jan 28 01:00:24.128879 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 187/345] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:23 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:24.583066 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-89986c52-64dd-4cbf-b0c3-bf68e6e682f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:24.583693 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-89986c52-64dd-4cbf-b0c3-bf68e6e682f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:24.589667 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-89986c52-64dd-4cbf-b0c3-bf68e6e682f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:24.590112 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-89986c52-64dd-4cbf-b0c3-bf68e6e682f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:24.590937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-89986c52-64dd-4cbf-b0c3-bf68e6e682f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:24.591371 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-89986c52-64dd-4cbf-b0c3-bf68e6e682f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:24.722226 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-89986c52-64dd-4cbf-b0c3-bf68e6e682f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:24.729555 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-89986c52-64dd-4cbf-b0c3-bf68e6e682f7 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1499 microversion: 2.1 time: 0.150109 Jan 28 01:00:24.730120 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 159/346] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:24 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1499 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:25.088749 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-50d35711-005b-4f1e-87be-c4b646a0b1c3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:25.089962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-50d35711-005b-4f1e-87be-c4b646a0b1c3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:25.096997 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-50d35711-005b-4f1e-87be-c4b646a0b1c3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:25.097450 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-50d35711-005b-4f1e-87be-c4b646a0b1c3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:25.098261 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-50d35711-005b-4f1e-87be-c4b646a0b1c3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:25.098697 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-50d35711-005b-4f1e-87be-c4b646a0b1c3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:25.146251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:25.146865 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:25.154504 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:25.154828 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:25.155412 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:25.155854 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:25.236013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-50d35711-005b-4f1e-87be-c4b646a0b1c3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:25.244015 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-50d35711-005b-4f1e-87be-c4b646a0b1c3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.158876 Jan 28 01:00:25.244597 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 188/347] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:25 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:25.295896 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:25.303963 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:25.305478 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:25.306648 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-481598ce-ebca-4f6e-b247-7b23f87af4c7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1721 microversion: 2.20 time: 0.164284 Jan 28 01:00:25.307260 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 160/348] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:25 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:26.264792 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ab02b52a-313d-4518-943b-d265bad1b2da tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:26.265784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ab02b52a-313d-4518-943b-d265bad1b2da tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:26.275929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ab02b52a-313d-4518-943b-d265bad1b2da tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:26.276528 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ab02b52a-313d-4518-943b-d265bad1b2da tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:26.277333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ab02b52a-313d-4518-943b-d265bad1b2da tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:26.278329 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ab02b52a-313d-4518-943b-d265bad1b2da tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:26.328076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:26.328815 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:26.335278 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:26.335732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:26.336533 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:26.336974 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:26.447784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ab02b52a-313d-4518-943b-d265bad1b2da tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:26.460036 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ab02b52a-313d-4518-943b-d265bad1b2da tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.202207 Jan 28 01:00:26.460734 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 189/349] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:26 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:26.510128 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:26.519221 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:26.520660 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:26.521844 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f3e5d7c5-a204-402c-93e0-8e2e1278b255 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1721 microversion: 2.20 time: 0.198130 Jan 28 01:00:26.522917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 161/350] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:26 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:27.477606 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c7c057e9-0de7-4d62-8f94-f93dac9ddd9a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:27.478208 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c7c057e9-0de7-4d62-8f94-f93dac9ddd9a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:27.485184 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7c057e9-0de7-4d62-8f94-f93dac9ddd9a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.485626 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7c057e9-0de7-4d62-8f94-f93dac9ddd9a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.486533 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7c057e9-0de7-4d62-8f94-f93dac9ddd9a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.486997 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7c057e9-0de7-4d62-8f94-f93dac9ddd9a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.538556 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7cb6411f-5f23-4350-80b4-ab85f6043860 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:27.539245 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7cb6411f-5f23-4350-80b4-ab85f6043860 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:27.547022 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cb6411f-5f23-4350-80b4-ab85f6043860 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.547465 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cb6411f-5f23-4350-80b4-ab85f6043860 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.548367 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cb6411f-5f23-4350-80b4-ab85f6043860 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.548999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7cb6411f-5f23-4350-80b4-ab85f6043860 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.576218 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7cb6411f-5f23-4350-80b4-ab85f6043860 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:00:27.673227 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c7c057e9-0de7-4d62-8f94-f93dac9ddd9a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:27.683722 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c7c057e9-0de7-4d62-8f94-f93dac9ddd9a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.209406 Jan 28 01:00:27.684854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 190/351] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:27 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:27.689686 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:27.690565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:27.696944 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.697512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.698818 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.699994 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.721339 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7cb6411f-5f23-4350-80b4-ab85f6043860 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "DELETE /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 204 len: 0 microversion: 2.1 time: 0.184283 Jan 28 01:00:27.722267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 162/352] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:00:27 2022] DELETE /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:00:27.735550 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-21372441-7c32-44a2-9e64-7ba76ea0e9f8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:27.736398 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-21372441-7c32-44a2-9e64-7ba76ea0e9f8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:27.748923 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-21372441-7c32-44a2-9e64-7ba76ea0e9f8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.750513 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-21372441-7c32-44a2-9e64-7ba76ea0e9f8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.752138 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-21372441-7c32-44a2-9e64-7ba76ea0e9f8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.753219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-21372441-7c32-44a2-9e64-7ba76ea0e9f8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.882458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:27.892963 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:27.894783 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:27.896209 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f62174de-b802-4ac9-821c-29ddd4486c7a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1724 microversion: 2.20 time: 0.210184 Jan 28 01:00:27.896903 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 191/353] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:27 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:27.916009 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-014f4954-25e6-4c00-932e-2202b7ed22a7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a65516d4-3f00-4d44-8935-ea03afc115be"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:27.917206 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-014f4954-25e6-4c00-932e-2202b7ed22a7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:27.923788 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-014f4954-25e6-4c00-932e-2202b7ed22a7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.924277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-014f4954-25e6-4c00-932e-2202b7ed22a7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.925305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-014f4954-25e6-4c00-932e-2202b7ed22a7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.925914 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-014f4954-25e6-4c00-932e-2202b7ed22a7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.935115 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-21372441-7c32-44a2-9e64-7ba76ea0e9f8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:27.942040 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-21372441-7c32-44a2-9e64-7ba76ea0e9f8 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1505 microversion: 2.1 time: 0.213799 Jan 28 01:00:27.942600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 163/354] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:27 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:28.249103 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-014f4954-25e6-4c00-932e-2202b7ed22a7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337241 Jan 28 01:00:28.249717 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 192/355] 10.222.0.78 () {62 vars in 1363 bytes} [Fri Jan 28 01:00:27 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:00:28.372254 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f7367eb0-b339-400e-8771-9596872e1b50 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:28.372837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f7367eb0-b339-400e-8771-9596872e1b50 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:28.379373 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7367eb0-b339-400e-8771-9596872e1b50 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.379828 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7367eb0-b339-400e-8771-9596872e1b50 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.380632 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7367eb0-b339-400e-8771-9596872e1b50 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.381080 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f7367eb0-b339-400e-8771-9596872e1b50 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.490872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f7367eb0-b339-400e-8771-9596872e1b50 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action" status: 202 len: 0 microversion: 2.20 time: 0.122595 Jan 28 01:00:28.491578 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 164/356] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:00:28 2022] POST /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:00:28.500346 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:28.501793 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:28.509206 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.509656 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.510508 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.511812 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.663960 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:28.676781 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:28.679725 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:28.681720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1f57d0d8-2999-4c19-81c6-d0a87c56dabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1750 microversion: 2.20 time: 0.185450 Jan 28 01:00:28.682844 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 193/357] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:28 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:28.704928 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-34b42121-2e12-496a-b65f-466695291350 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:28.706057 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-34b42121-2e12-496a-b65f-466695291350 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:28.714848 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34b42121-2e12-496a-b65f-466695291350 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.716161 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34b42121-2e12-496a-b65f-466695291350 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.717551 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34b42121-2e12-496a-b65f-466695291350 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.718222 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34b42121-2e12-496a-b65f-466695291350 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.931143 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-34b42121-2e12-496a-b65f-466695291350 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:28.941225 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-34b42121-2e12-496a-b65f-466695291350 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.242063 Jan 28 01:00:28.951564 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 165/358] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:28 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:28.962245 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-50752b68-d36c-4110-99ac-ea38f1bd2601 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:28.962981 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-50752b68-d36c-4110-99ac-ea38f1bd2601 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:28.971417 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-50752b68-d36c-4110-99ac-ea38f1bd2601 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.972217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-50752b68-d36c-4110-99ac-ea38f1bd2601 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.973092 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-50752b68-d36c-4110-99ac-ea38f1bd2601 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.973687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-50752b68-d36c-4110-99ac-ea38f1bd2601 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:29.233737 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-50752b68-d36c-4110-99ac-ea38f1bd2601 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:29.241892 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-50752b68-d36c-4110-99ac-ea38f1bd2601 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1505 microversion: 2.1 time: 0.283808 Jan 28 01:00:29.242484 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 194/359] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:28 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:29.709482 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:29.711428 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:29.723833 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:29.724904 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:29.726439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:29.727291 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:29.958079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e2813ed1-81e2-4349-8cd9-75bc99519ec8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:29.958808 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e2813ed1-81e2-4349-8cd9-75bc99519ec8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:29.968228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e2813ed1-81e2-4349-8cd9-75bc99519ec8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:29.970932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e2813ed1-81e2-4349-8cd9-75bc99519ec8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:29.970932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e2813ed1-81e2-4349-8cd9-75bc99519ec8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:29.971232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e2813ed1-81e2-4349-8cd9-75bc99519ec8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:29.973718 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:29.982961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:29.984726 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:29.986096 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bed65df5-56f9-4fec-a65a-2846ad22119d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1750 microversion: 2.20 time: 0.283686 Jan 28 01:00:29.987214 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 166/360] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:29 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1750 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:30.190264 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e2813ed1-81e2-4349-8cd9-75bc99519ec8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:30.205943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e2813ed1-81e2-4349-8cd9-75bc99519ec8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.251345 Jan 28 01:00:30.208198 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 195/361] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:29 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:30.263981 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9d628112-03da-4c21-9dfe-2f03ef58c4ac tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:30.264607 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9d628112-03da-4c21-9dfe-2f03ef58c4ac tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:30.274371 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d628112-03da-4c21-9dfe-2f03ef58c4ac tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:30.274849 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d628112-03da-4c21-9dfe-2f03ef58c4ac tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:30.275916 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d628112-03da-4c21-9dfe-2f03ef58c4ac tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:30.276107 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d628112-03da-4c21-9dfe-2f03ef58c4ac tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:30.395035 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-9d628112-03da-4c21-9dfe-2f03ef58c4ac tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:30.425801 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9d628112-03da-4c21-9dfe-2f03ef58c4ac tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 200 len: 1463 microversion: 2.1 time: 0.156503 Jan 28 01:00:30.425801 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 167/362] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:30 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:30.450978 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-b8386ce5-beae-48aa-9562-1f151908ffd7 req-15ba6781-e22b-4866-a4e6-c0112f46fc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93eab28c-4c8f-4e2b-94a5-17230141040a", "name": "network-vif-deleted", "tag": "5f980b28-87a1-4775-8cd3-bd5038fc9cf1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:30.452759 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:30.452759 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:00:30.464423 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-b8386ce5-beae-48aa-9562-1f151908ffd7 req-15ba6781-e22b-4866-a4e6-c0112f46fc95 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:30.465883 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-b8386ce5-beae-48aa-9562-1f151908ffd7 req-15ba6781-e22b-4866-a4e6-c0112f46fc95 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:30.490264 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-b8386ce5-beae-48aa-9562-1f151908ffd7 req-15ba6781-e22b-4866-a4e6-c0112f46fc95 service nova] Creating event network-vif-deleted:5f980b28-87a1-4775-8cd3-bd5038fc9cf1 for instance 93eab28c-4c8f-4e2b-94a5-17230141040a on hv-cinder-81689 Jan 28 01:00:30.497399 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-b8386ce5-beae-48aa-9562-1f151908ffd7 req-15ba6781-e22b-4866-a4e6-c0112f46fc95 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051126 Jan 28 01:00:30.498382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 196/363] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:31.018542 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:31.020265 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:31.036131 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.036910 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.039247 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.040282 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.134974 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e9937ce7-5112-4dec-b666-44d3d6c3ae6b tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:31.136347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e9937ce7-5112-4dec-b666-44d3d6c3ae6b tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:31.149618 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e9937ce7-5112-4dec-b666-44d3d6c3ae6b tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.150352 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e9937ce7-5112-4dec-b666-44d3d6c3ae6b tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.151375 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e9937ce7-5112-4dec-b666-44d3d6c3ae6b tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.152150 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e9937ce7-5112-4dec-b666-44d3d6c3ae6b tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.306396 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:31.315785 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:31.317327 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:31.318867 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b0889ee7-0cf4-4dd0-bfce-13665cc2d6dd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.308305 Jan 28 01:00:31.319638 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 168/364] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:31 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:31.328730 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-03809a6d-ad61-4fcc-afa3-78c29f27ebf2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:31.329404 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-03809a6d-ad61-4fcc-afa3-78c29f27ebf2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:31.341061 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-e9937ce7-5112-4dec-b666-44d3d6c3ae6b tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lazy-loading 'services' on Instance uuid da1024b0-1f5b-45b0-9780-abb901287988 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:00:31.342219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03809a6d-ad61-4fcc-afa3-78c29f27ebf2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.342720 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03809a6d-ad61-4fcc-afa3-78c29f27ebf2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.343800 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03809a6d-ad61-4fcc-afa3-78c29f27ebf2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.344259 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03809a6d-ad61-4fcc-afa3-78c29f27ebf2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.518780 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e9937ce7-5112-4dec-b666-44d3d6c3ae6b tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988/os-volume_attachments/1c69fc95-58ab-49d1-9d0c-70f1ae9b2a59" status: 202 len: 0 microversion: 2.1 time: 0.388601 Jan 28 01:00:31.520132 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 197/365] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:00:31 2022] DELETE /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988/os-volume_attachments/1c69fc95-58ab-49d1-9d0c-70f1ae9b2a59 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:00:31.540512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b0831804-c75c-4ab8-986d-e14efe13723b tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:31.542810 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b0831804-c75c-4ab8-986d-e14efe13723b tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: 93eab28c-4c8f-4e2b-94a5-17230141040a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:31.553629 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b0831804-c75c-4ab8-986d-e14efe13723b tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.554758 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b0831804-c75c-4ab8-986d-e14efe13723b tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.555976 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b0831804-c75c-4ab8-986d-e14efe13723b tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.556782 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b0831804-c75c-4ab8-986d-e14efe13723b tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.573241 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-b0831804-c75c-4ab8-986d-e14efe13723b tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] HTTP exception thrown: Instance 93eab28c-4c8f-4e2b-94a5-17230141040a could not be found. Jan 28 01:00:31.574364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b0831804-c75c-4ab8-986d-e14efe13723b tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Returning 404 to user: Instance 93eab28c-4c8f-4e2b-94a5-17230141040a could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:00:31.575932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b0831804-c75c-4ab8-986d-e14efe13723b tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a" status: 404 len: 111 microversion: 2.1 time: 0.054389 Jan 28 01:00:31.576651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 198/366] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:31 2022] GET /compute/v2.1/servers/93eab28c-4c8f-4e2b-94a5-17230141040a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:00:31.657705 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-03809a6d-ad61-4fcc-afa3-78c29f27ebf2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:31.669039 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-03809a6d-ad61-4fcc-afa3-78c29f27ebf2 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.348042 Jan 28 01:00:31.673402 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 169/367] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:31 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:31.769945 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-865096449", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "networks": [{"uuid": "e44d5089-38c5-4112-a3d1-3d8601d191f4"}]}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:31.852152 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] validate_networks() for [('e44d5089-38c5-4112-a3d1-3d8601d191f4', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:00:32.347014 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:32.348121 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:32.361483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.362231 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.363381 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.363981 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.641802 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:00:32.642721 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:00:32.643549 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:00:32.644183 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:00:32.644913 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:00:32.661099 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.661541 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.662546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.663171 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.688318 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Getting quotas for project 65c173bb6e2e4edba095bbd06228bbc3. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:00:32.694992 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Getting quotas for user 256021e079304993a03de9232cba80e4 and project 65c173bb6e2e4edba095bbd06228bbc3. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:00:32.709410 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:00:32.712038 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:00:32.748100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:32.780494 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:32.784381 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8b32b0ac-4fa5-46e2-9caf-528649ecda34 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.018578 Jan 28 01:00:32.786220 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 199/368] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:00:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:00:32.791304 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9150553a-b53d-4d3b-9499-5e56a3331c8a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:32.792162 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9150553a-b53d-4d3b-9499-5e56a3331c8a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:32.796169 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:32.799085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e0ce271e-bb74-4658-8ee1-7bf68dcfd6b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.462810 Jan 28 01:00:32.802655 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9150553a-b53d-4d3b-9499-5e56a3331c8a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.803390 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9150553a-b53d-4d3b-9499-5e56a3331c8a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.804830 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9150553a-b53d-4d3b-9499-5e56a3331c8a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.805570 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9150553a-b53d-4d3b-9499-5e56a3331c8a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.815862 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 170/369] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:32 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:32.837332 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2a3148dd-1ac8-4a59-9ab1-187c684a8310 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:32.838308 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2a3148dd-1ac8-4a59-9ab1-187c684a8310 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:32.884382 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2a3148dd-1ac8-4a59-9ab1-187c684a8310 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.897937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2a3148dd-1ac8-4a59-9ab1-187c684a8310 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.905275 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2a3148dd-1ac8-4a59-9ab1-187c684a8310 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.906178 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2a3148dd-1ac8-4a59-9ab1-187c684a8310 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.964471 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2a3148dd-1ac8-4a59-9ab1-187c684a8310 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:00:33.121677 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2a3148dd-1ac8-4a59-9ab1-187c684a8310 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 204 len: 0 microversion: 2.1 time: 0.303160 Jan 28 01:00:33.124748 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 171/370] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:00:32 2022] DELETE /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:00:33.134376 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2bd9193d-44f2-45b1-8729-79a6429d5142 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:33.136065 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2bd9193d-44f2-45b1-8729-79a6429d5142 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:33.282337 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2bd9193d-44f2-45b1-8729-79a6429d5142 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:33.292700 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2bd9193d-44f2-45b1-8729-79a6429d5142 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1213 microversion: 2.1 time: 0.164967 Jan 28 01:00:33.312976 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 172/371] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:33 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1213 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:33.323808 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4d853c28-0b0c-445a-99ba-3f49347daf85 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:33.325492 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4d853c28-0b0c-445a-99ba-3f49347daf85 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:33.336654 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4d853c28-0b0c-445a-99ba-3f49347daf85 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:33.337501 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4d853c28-0b0c-445a-99ba-3f49347daf85 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:33.338339 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4d853c28-0b0c-445a-99ba-3f49347daf85 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:33.339013 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4d853c28-0b0c-445a-99ba-3f49347daf85 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:33.452767 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9150553a-b53d-4d3b-9499-5e56a3331c8a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:33.482661 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9150553a-b53d-4d3b-9499-5e56a3331c8a tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.691701 Jan 28 01:00:33.483672 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 200/372] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:32 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:33.734583 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4d853c28-0b0c-445a-99ba-3f49347daf85 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:33.751681 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4d853c28-0b0c-445a-99ba-3f49347daf85 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1513 microversion: 2.1 time: 0.436412 Jan 28 01:00:33.762411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 173/373] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:33 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:33.828564 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:33.829382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:33.842840 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:33.843765 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:33.844683 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:33.845542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:34.160467 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:34.171173 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:34.173162 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:34.174873 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c68c23a6-3fa4-4df4-9ec7-078ed4288649 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.352356 Jan 28 01:00:34.176114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 201/374] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:33 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:34.325180 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4a800e84-5f81-4bfa-9bea-5ec81ce635b4 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:34.325821 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4a800e84-5f81-4bfa-9bea-5ec81ce635b4 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:34.356759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a800e84-5f81-4bfa-9bea-5ec81ce635b4 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:34.357556 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a800e84-5f81-4bfa-9bea-5ec81ce635b4 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:34.360239 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a800e84-5f81-4bfa-9bea-5ec81ce635b4 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:34.361083 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a800e84-5f81-4bfa-9bea-5ec81ce635b4 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:34.503561 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-38db283d-1c67-4bc7-95dd-5f8ad60516a8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:34.506377 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-38db283d-1c67-4bc7-95dd-5f8ad60516a8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:34.528278 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-38db283d-1c67-4bc7-95dd-5f8ad60516a8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:34.534042 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-38db283d-1c67-4bc7-95dd-5f8ad60516a8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:34.535679 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-38db283d-1c67-4bc7-95dd-5f8ad60516a8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:34.536642 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-38db283d-1c67-4bc7-95dd-5f8ad60516a8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:34.554600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4a800e84-5f81-4bfa-9bea-5ec81ce635b4 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:34.574020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4a800e84-5f81-4bfa-9bea-5ec81ce635b4 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1265 microversion: 2.1 time: 0.252747 Jan 28 01:00:34.586853 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 174/375] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:34 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:34.775112 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6dbe5918-0ceb-4d03-85d5-7a32f035018c tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:34.776692 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6dbe5918-0ceb-4d03-85d5-7a32f035018c tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:34.814419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6dbe5918-0ceb-4d03-85d5-7a32f035018c tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:34.817390 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6dbe5918-0ceb-4d03-85d5-7a32f035018c tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:34.833942 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6dbe5918-0ceb-4d03-85d5-7a32f035018c tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:34.834565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6dbe5918-0ceb-4d03-85d5-7a32f035018c tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:35.005416 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-38db283d-1c67-4bc7-95dd-5f8ad60516a8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:35.014900 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-38db283d-1c67-4bc7-95dd-5f8ad60516a8 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.516650 Jan 28 01:00:35.019432 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 202/376] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:34 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:35.198788 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:35.200816 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:35.220893 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:35.227060 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:35.228172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:35.228815 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:35.327009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6dbe5918-0ceb-4d03-85d5-7a32f035018c tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:35.338038 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6dbe5918-0ceb-4d03-85d5-7a32f035018c tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1513 microversion: 2.1 time: 0.568856 Jan 28 01:00:35.342075 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 175/377] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:34 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1513 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:35.608756 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1764e5b8-2ef1-462d-9a81-76e8e9dcf7dd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:35.609391 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1764e5b8-2ef1-462d-9a81-76e8e9dcf7dd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:35.620871 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1764e5b8-2ef1-462d-9a81-76e8e9dcf7dd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:35.631686 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1764e5b8-2ef1-462d-9a81-76e8e9dcf7dd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:35.633655 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1764e5b8-2ef1-462d-9a81-76e8e9dcf7dd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:35.634273 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1764e5b8-2ef1-462d-9a81-76e8e9dcf7dd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:35.796047 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1764e5b8-2ef1-462d-9a81-76e8e9dcf7dd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:35.814118 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1764e5b8-2ef1-462d-9a81-76e8e9dcf7dd tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1271 microversion: 2.1 time: 0.209092 Jan 28 01:00:35.815332 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 176/378] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:35 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:35.897297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:35.931793 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:35.933326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:35.934597 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-23b717a1-bb1e-4687-81ae-92e2195f21d7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.742975 Jan 28 01:00:35.951813 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 203/379] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:35 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:36.046051 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-639e2728-3cee-4c33-94e9-3a27a75da81b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:36.047161 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-639e2728-3cee-4c33-94e9-3a27a75da81b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:36.055399 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-639e2728-3cee-4c33-94e9-3a27a75da81b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.056310 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-639e2728-3cee-4c33-94e9-3a27a75da81b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.057948 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-639e2728-3cee-4c33-94e9-3a27a75da81b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.059001 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-639e2728-3cee-4c33-94e9-3a27a75da81b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.368153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-616447d7-7efb-4e7a-a97a-f5a60c0041c1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:36.370352 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-616447d7-7efb-4e7a-a97a-f5a60c0041c1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:36.395735 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-616447d7-7efb-4e7a-a97a-f5a60c0041c1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.404125 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-616447d7-7efb-4e7a-a97a-f5a60c0041c1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.406042 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-616447d7-7efb-4e7a-a97a-f5a60c0041c1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.410711 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-616447d7-7efb-4e7a-a97a-f5a60c0041c1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.773805 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-616447d7-7efb-4e7a-a97a-f5a60c0041c1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:36.785753 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-616447d7-7efb-4e7a-a97a-f5a60c0041c1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1513 microversion: 2.1 time: 0.426926 Jan 28 01:00:36.798222 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 204/380] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:36 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1513 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:36.838193 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7ec37a1b-a8b8-49d4-b248-75371948c139 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:36.838858 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7ec37a1b-a8b8-49d4-b248-75371948c139 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:36.839873 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-639e2728-3cee-4c33-94e9-3a27a75da81b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:36.850362 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-639e2728-3cee-4c33-94e9-3a27a75da81b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.809345 Jan 28 01:00:36.852172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7ec37a1b-a8b8-49d4-b248-75371948c139 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.852707 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7ec37a1b-a8b8-49d4-b248-75371948c139 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.853937 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7ec37a1b-a8b8-49d4-b248-75371948c139 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.854383 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7ec37a1b-a8b8-49d4-b248-75371948c139 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.868269 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 177/381] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:36 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:36.960474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:36.961324 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:36.978566 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.979507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.980675 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.981362 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:37.343083 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:37.358276 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:37.381294 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:37.382034 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e8e47fd5-308b-431b-95de-182a36a10fa0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.426296 Jan 28 01:00:37.383104 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 178/382] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:36 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:37.733343 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7ec37a1b-a8b8-49d4-b248-75371948c139 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:37.749243 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7ec37a1b-a8b8-49d4-b248-75371948c139 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.914473 Jan 28 01:00:37.750241 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 205/383] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:36 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:37.807211 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-480ac311-2585-49c9-a06d-c153287ac60a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:37.808330 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-480ac311-2585-49c9-a06d-c153287ac60a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:37.828594 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-480ac311-2585-49c9-a06d-c153287ac60a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:37.848943 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-480ac311-2585-49c9-a06d-c153287ac60a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:37.848943 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-480ac311-2585-49c9-a06d-c153287ac60a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:37.848943 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-480ac311-2585-49c9-a06d-c153287ac60a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:37.877922 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-dacb308a-b8d5-4859-b0a4-2ad8ac17020e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:37.878543 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-dacb308a-b8d5-4859-b0a4-2ad8ac17020e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:37.888690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dacb308a-b8d5-4859-b0a4-2ad8ac17020e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:37.889224 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dacb308a-b8d5-4859-b0a4-2ad8ac17020e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:37.890043 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dacb308a-b8d5-4859-b0a4-2ad8ac17020e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:37.890483 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dacb308a-b8d5-4859-b0a4-2ad8ac17020e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:38.295943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-dacb308a-b8d5-4859-b0a4-2ad8ac17020e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:38.319420 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-dacb308a-b8d5-4859-b0a4-2ad8ac17020e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.442589 Jan 28 01:00:38.323084 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 206/384] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:37 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:38.404461 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:38.405471 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:38.429047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:38.431751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:38.432995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:38.441813 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:38.659905 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-480ac311-2585-49c9-a06d-c153287ac60a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:38.678719 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-480ac311-2585-49c9-a06d-c153287ac60a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1513 microversion: 2.1 time: 0.876112 Jan 28 01:00:38.680351 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 179/385] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:37 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1513 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:38.777990 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-35c431ae-9e94-4e72-bbd7-74ac1d6f2a85 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:38.780596 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-35c431ae-9e94-4e72-bbd7-74ac1d6f2a85 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:38.814310 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35c431ae-9e94-4e72-bbd7-74ac1d6f2a85 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:38.815182 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35c431ae-9e94-4e72-bbd7-74ac1d6f2a85 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:38.823540 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35c431ae-9e94-4e72-bbd7-74ac1d6f2a85 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:38.827031 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35c431ae-9e94-4e72-bbd7-74ac1d6f2a85 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:39.194955 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:39.205983 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:39.221433 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:39.224280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9b39324e-d282-4996-8bec-2420e9a31c85 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.825045 Jan 28 01:00:39.226067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 207/386] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:38 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:39.349644 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0b7b5936-76ad-41dc-8d21-8e51e9fab5e7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:39.350918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0b7b5936-76ad-41dc-8d21-8e51e9fab5e7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:39.376888 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0b7b5936-76ad-41dc-8d21-8e51e9fab5e7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:39.378232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0b7b5936-76ad-41dc-8d21-8e51e9fab5e7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:39.380414 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0b7b5936-76ad-41dc-8d21-8e51e9fab5e7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:39.382348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0b7b5936-76ad-41dc-8d21-8e51e9fab5e7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:39.584991 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-35c431ae-9e94-4e72-bbd7-74ac1d6f2a85 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:39.660334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-35c431ae-9e94-4e72-bbd7-74ac1d6f2a85 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.892186 Jan 28 01:00:39.661134 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 180/387] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:38 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:39.703461 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bf43e61f-9fd1-455f-b5e4-39c92bb79aff tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:39.704448 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-bf43e61f-9fd1-455f-b5e4-39c92bb79aff tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:39.718715 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bf43e61f-9fd1-455f-b5e4-39c92bb79aff tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:39.721586 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bf43e61f-9fd1-455f-b5e4-39c92bb79aff tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:39.722783 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bf43e61f-9fd1-455f-b5e4-39c92bb79aff tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:39.724766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bf43e61f-9fd1-455f-b5e4-39c92bb79aff tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:40.341319 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0b7b5936-76ad-41dc-8d21-8e51e9fab5e7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:40.369962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0b7b5936-76ad-41dc-8d21-8e51e9fab5e7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 1.026115 Jan 28 01:00:40.383123 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 208/388] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:39 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:40.399151 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-c5d50ef8-192a-49b7-bf89-9af7e45f2a41 req-6ef816d7-7af9-498d-9acb-2564727f4096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd356939-ae04-408e-ba0a-bb9bf12d7a36", "tag": "43cbe1a5-2a85-4721-8c67-6ae16336682b"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:40.402507 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:40.402507 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:00:40.426877 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-c5d50ef8-192a-49b7-bf89-9af7e45f2a41 req-6ef816d7-7af9-498d-9acb-2564727f4096 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:40.430654 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-c5d50ef8-192a-49b7-bf89-9af7e45f2a41 req-6ef816d7-7af9-498d-9acb-2564727f4096 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:40.458672 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-c5d50ef8-192a-49b7-bf89-9af7e45f2a41 req-6ef816d7-7af9-498d-9acb-2564727f4096 service nova] Creating event network-changed:43cbe1a5-2a85-4721-8c67-6ae16336682b for instance dd356939-ae04-408e-ba0a-bb9bf12d7a36 on hv-cinder-81689 Jan 28 01:00:40.468561 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-c5d50ef8-192a-49b7-bf89-9af7e45f2a41 req-6ef816d7-7af9-498d-9acb-2564727f4096 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082066 Jan 28 01:00:40.470337 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 209/389] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:40.481389 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:40.484488 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:40.497367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:40.498454 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:40.500097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:40.502265 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:40.643059 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-bf43e61f-9fd1-455f-b5e4-39c92bb79aff tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:40.673085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bf43e61f-9fd1-455f-b5e4-39c92bb79aff tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1513 microversion: 2.1 time: 0.973905 Jan 28 01:00:40.690363 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 181/390] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:39 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1513 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:40.713916 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d659b5ab-c864-4ee8-aef4-fea78e046253 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:40.726219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d659b5ab-c864-4ee8-aef4-fea78e046253 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:40.743400 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d659b5ab-c864-4ee8-aef4-fea78e046253 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:40.748792 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d659b5ab-c864-4ee8-aef4-fea78e046253 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:40.764621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d659b5ab-c864-4ee8-aef4-fea78e046253 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:40.768243 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d659b5ab-c864-4ee8-aef4-fea78e046253 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:41.016156 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:41.032808 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:41.036361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:41.038609 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5c0c072c-6219-4f60-9c45-2d2a964bd2cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.566439 Jan 28 01:00:41.052287 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 210/391] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:40 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:41.285681 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d659b5ab-c864-4ee8-aef4-fea78e046253 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:41.298336 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d659b5ab-c864-4ee8-aef4-fea78e046253 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.605577 Jan 28 01:00:41.299973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 182/392] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:40 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:41.412776 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ddfca723-52a6-435b-b165-c929bb486d38 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:41.414827 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ddfca723-52a6-435b-b165-c929bb486d38 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:41.446046 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ddfca723-52a6-435b-b165-c929bb486d38 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:41.449118 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ddfca723-52a6-435b-b165-c929bb486d38 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:41.459695 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ddfca723-52a6-435b-b165-c929bb486d38 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:41.465073 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ddfca723-52a6-435b-b165-c929bb486d38 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:41.700112 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-88b2aeea-80da-42f7-97e6-dc8a2626a9ca tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:41.700992 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-88b2aeea-80da-42f7-97e6-dc8a2626a9ca tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:41.707945 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-88b2aeea-80da-42f7-97e6-dc8a2626a9ca tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:41.713552 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-88b2aeea-80da-42f7-97e6-dc8a2626a9ca tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:41.721692 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-88b2aeea-80da-42f7-97e6-dc8a2626a9ca tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:41.722495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-88b2aeea-80da-42f7-97e6-dc8a2626a9ca tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:41.776273 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ddfca723-52a6-435b-b165-c929bb486d38 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:41.810397 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ddfca723-52a6-435b-b165-c929bb486d38 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.415706 Jan 28 01:00:41.811012 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 211/393] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:41 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:41.867143 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-88b2aeea-80da-42f7-97e6-dc8a2626a9ca tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:41.877962 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-88b2aeea-80da-42f7-97e6-dc8a2626a9ca tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1471 microversion: 2.1 time: 0.184284 Jan 28 01:00:41.882938 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 183/394] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:41 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:42.066563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:42.067281 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:42.082644 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:42.084186 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:42.087493 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:42.087995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:42.335331 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ed0099fa-f965-4465-8e8a-3b555267f837 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:42.337267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ed0099fa-f965-4465-8e8a-3b555267f837 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:42.359255 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ed0099fa-f965-4465-8e8a-3b555267f837 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:42.367617 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ed0099fa-f965-4465-8e8a-3b555267f837 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:42.369174 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ed0099fa-f965-4465-8e8a-3b555267f837 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:42.370697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ed0099fa-f965-4465-8e8a-3b555267f837 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:42.513650 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:42.552779 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:42.555186 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:42.557217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9a22aec6-ca8b-4fda-ab36-a16b3b15d67c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.496137 Jan 28 01:00:42.558969 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 212/395] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:42 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:42.580358 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-8cf156ab-3b3b-4b04-a60f-1904e857a8a5 req-729d426f-7e0e-4754-9086-ff487f1427d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1024b0-1f5b-45b0-9780-abb901287988", "name": "network-vif-deleted", "tag": "e8a2f591-0a29-4bfe-a85d-856e9bb034df"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:42.584182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:42.584182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:00:42.603159 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-8cf156ab-3b3b-4b04-a60f-1904e857a8a5 req-729d426f-7e0e-4754-9086-ff487f1427d2 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:42.609970 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-8cf156ab-3b3b-4b04-a60f-1904e857a8a5 req-729d426f-7e0e-4754-9086-ff487f1427d2 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:42.652385 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-8cf156ab-3b3b-4b04-a60f-1904e857a8a5 req-729d426f-7e0e-4754-9086-ff487f1427d2 service nova] Creating event network-vif-deleted:e8a2f591-0a29-4bfe-a85d-856e9bb034df for instance da1024b0-1f5b-45b0-9780-abb901287988 on hv-cinder-81689 Jan 28 01:00:42.665879 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-8cf156ab-3b3b-4b04-a60f-1904e857a8a5 req-729d426f-7e0e-4754-9086-ff487f1427d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093923 Jan 28 01:00:42.667819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 213/396] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:42.835635 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a27953e3-6946-4a25-8262-d27b7773b403 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:42.836338 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a27953e3-6946-4a25-8262-d27b7773b403 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:42.849715 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a27953e3-6946-4a25-8262-d27b7773b403 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:42.850787 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a27953e3-6946-4a25-8262-d27b7773b403 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:42.856422 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a27953e3-6946-4a25-8262-d27b7773b403 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:42.856422 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a27953e3-6946-4a25-8262-d27b7773b403 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:43.162482 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a27953e3-6946-4a25-8262-d27b7773b403 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:43.190131 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a27953e3-6946-4a25-8262-d27b7773b403 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.358019 Jan 28 01:00:43.192479 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 214/397] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:42 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:43.202266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:43.203348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:43.216046 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:43.217076 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:43.219256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:43.220386 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:43.300533 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:43.304195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:43.305802 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lazy-loading 'fault' on Instance uuid da1024b0-1f5b-45b0-9780-abb901287988 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:00:43.467130 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:43.495279 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f7d3888f-485b-4f07-9354-5c3206f4e066 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 200 len: 1309 microversion: 2.1 time: 0.297175 Jan 28 01:00:43.497079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 215/398] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:43 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:43.584689 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:43.590229 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:43.620865 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:43.624055 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:43.625247 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:43.626217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:44.006790 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ed0099fa-f965-4465-8e8a-3b555267f837 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:44.009440 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:44.029505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:44.036030 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ed0099fa-f965-4465-8e8a-3b555267f837 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 1.713948 Jan 28 01:00:44.037063 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 184/399] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:42 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:44.038336 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:44.045564 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-496fd01d-cea6-487f-8251-3aad39bbb698 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.469731 Jan 28 01:00:44.051017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 216/400] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:43 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:44.222560 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4a849b0b-cf9c-46f4-97c8-aec7269b69d0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:44.223744 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4a849b0b-cf9c-46f4-97c8-aec7269b69d0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:44.237050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a849b0b-cf9c-46f4-97c8-aec7269b69d0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:44.237873 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a849b0b-cf9c-46f4-97c8-aec7269b69d0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:44.239351 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a849b0b-cf9c-46f4-97c8-aec7269b69d0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:44.240516 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a849b0b-cf9c-46f4-97c8-aec7269b69d0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:44.515134 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1a82792b-5d0b-455c-a564-15d7ab0e99f5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:44.516067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1a82792b-5d0b-455c-a564-15d7ab0e99f5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: da1024b0-1f5b-45b0-9780-abb901287988] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:44.535393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a82792b-5d0b-455c-a564-15d7ab0e99f5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:44.535889 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a82792b-5d0b-455c-a564-15d7ab0e99f5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:44.536709 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a82792b-5d0b-455c-a564-15d7ab0e99f5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:44.537150 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a82792b-5d0b-455c-a564-15d7ab0e99f5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:44.576957 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-1a82792b-5d0b-455c-a564-15d7ab0e99f5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] HTTP exception thrown: Instance da1024b0-1f5b-45b0-9780-abb901287988 could not be found. Jan 28 01:00:44.577533 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1a82792b-5d0b-455c-a564-15d7ab0e99f5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Returning 404 to user: Instance da1024b0-1f5b-45b0-9780-abb901287988 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:00:44.583478 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1a82792b-5d0b-455c-a564-15d7ab0e99f5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988" status: 404 len: 111 microversion: 2.1 time: 0.072925 Jan 28 01:00:44.584054 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 217/401] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:44 2022] GET /compute/v2.1/servers/da1024b0-1f5b-45b0-9780-abb901287988 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:00:44.924811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4a849b0b-cf9c-46f4-97c8-aec7269b69d0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:44.961354 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4a849b0b-cf9c-46f4-97c8-aec7269b69d0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1569 microversion: 2.1 time: 0.744173 Jan 28 01:00:44.962478 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 185/402] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:44 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1569 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:45.065394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:45.065961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:45.067343 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9fdb2089-1769-4ed3-9b94-1c61852d295a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:45.068067 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9fdb2089-1769-4ed3-9b94-1c61852d295a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:45.075837 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:45.076266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:45.077079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:45.077520 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:45.093638 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9fdb2089-1769-4ed3-9b94-1c61852d295a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:45.101304 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9fdb2089-1769-4ed3-9b94-1c61852d295a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:45.104776 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9fdb2089-1769-4ed3-9b94-1c61852d295a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:45.107315 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9fdb2089-1769-4ed3-9b94-1c61852d295a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:45.495931 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:45.513820 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:45.515795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:45.517389 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9bac4708-cbd5-495f-8311-a213ee16623c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.456053 Jan 28 01:00:45.520827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-9fdb2089-1769-4ed3-9b94-1c61852d295a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:45.529966 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9fdb2089-1769-4ed3-9b94-1c61852d295a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.468106 Jan 28 01:00:45.530565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 186/403] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:45 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:45.531688 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 218/404] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:45 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:46.010830 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-32ee050a-0234-43a9-b788-ec9a8da60dd6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:46.011803 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-32ee050a-0234-43a9-b788-ec9a8da60dd6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:46.018433 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-32ee050a-0234-43a9-b788-ec9a8da60dd6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.019298 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-32ee050a-0234-43a9-b788-ec9a8da60dd6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.020417 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-32ee050a-0234-43a9-b788-ec9a8da60dd6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.021002 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-32ee050a-0234-43a9-b788-ec9a8da60dd6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.235743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-32ee050a-0234-43a9-b788-ec9a8da60dd6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:46.256259 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-32ee050a-0234-43a9-b788-ec9a8da60dd6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1549 microversion: 2.1 time: 0.248707 Jan 28 01:00:46.257323 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 187/405] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:45 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1549 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:46.277837 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4b6bc427-700d-45ff-b6cb-94d5d6cb84ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:46.278708 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4b6bc427-700d-45ff-b6cb-94d5d6cb84ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:46.285430 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4b6bc427-700d-45ff-b6cb-94d5d6cb84ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.285882 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4b6bc427-700d-45ff-b6cb-94d5d6cb84ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.286920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4b6bc427-700d-45ff-b6cb-94d5d6cb84ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.287535 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4b6bc427-700d-45ff-b6cb-94d5d6cb84ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.424043 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-4b6bc427-700d-45ff-b6cb-94d5d6cb84ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] HTTP exception thrown: Cannot 'detach_volume' instance 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 while it is in vm_state rescued Jan 28 01:00:46.425539 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4b6bc427-700d-45ff-b6cb-94d5d6cb84ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Returning 409 to user: Cannot 'detach_volume' instance 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 while it is in vm_state rescued {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:00:46.428203 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4b6bc427-700d-45ff-b6cb-94d5d6cb84ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "DELETE /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments/7e199043-cef6-4f9d-862b-bd6b0bacda7b" status: 409 len: 152 microversion: 2.1 time: 0.155433 Jan 28 01:00:46.429282 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 219/406] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:00:46 2022] DELETE /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments/7e199043-cef6-4f9d-862b-bd6b0bacda7b => generated 152 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 28 01:00:46.447257 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-653acbe2-a93b-4065-80fb-c960bf297257 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:46.448542 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-653acbe2-a93b-4065-80fb-c960bf297257 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:46.486076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-653acbe2-a93b-4065-80fb-c960bf297257 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.486763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-653acbe2-a93b-4065-80fb-c960bf297257 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.488125 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-653acbe2-a93b-4065-80fb-c960bf297257 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.493459 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-653acbe2-a93b-4065-80fb-c960bf297257 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.555124 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:46.556411 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:46.565915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.566763 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.567720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.568329 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.728445 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-653acbe2-a93b-4065-80fb-c960bf297257 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/action" status: 202 len: 0 microversion: 2.1 time: 0.291196 Jan 28 01:00:46.734232 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 188/407] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:00:46 2022] POST /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:00:46.741382 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-21ef2c0a-e332-49a3-be60-b0cd09ba3ac2 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:46.748626 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-21ef2c0a-e332-49a3-be60-b0cd09ba3ac2 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:46.777103 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-21ef2c0a-e332-49a3-be60-b0cd09ba3ac2 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.779978 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-21ef2c0a-e332-49a3-be60-b0cd09ba3ac2 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.783604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-21ef2c0a-e332-49a3-be60-b0cd09ba3ac2 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.784494 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-21ef2c0a-e332-49a3-be60-b0cd09ba3ac2 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:47.361248 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-21ef2c0a-e332-49a3-be60-b0cd09ba3ac2 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:47.375124 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-21ef2c0a-e332-49a3-be60-b0cd09ba3ac2 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.637298 Jan 28 01:00:47.380786 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 189/408] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:46 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:47.390346 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3a4eb963-f2ac-49c3-91fc-d6040c2030c7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:47.391653 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3a4eb963-f2ac-49c3-91fc-d6040c2030c7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:47.431737 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3a4eb963-f2ac-49c3-91fc-d6040c2030c7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:47.433394 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3a4eb963-f2ac-49c3-91fc-d6040c2030c7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:47.435719 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3a4eb963-f2ac-49c3-91fc-d6040c2030c7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:47.436703 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3a4eb963-f2ac-49c3-91fc-d6040c2030c7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:47.437080 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:47.473204 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:47.475125 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:47.476819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2f2219e3-46fc-47cc-bde0-ea83e7da48c6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.930528 Jan 28 01:00:47.477963 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 220/409] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:46 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:47.743100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3a4eb963-f2ac-49c3-91fc-d6040c2030c7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:47.761648 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3a4eb963-f2ac-49c3-91fc-d6040c2030c7 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1557 microversion: 2.1 time: 0.378510 Jan 28 01:00:47.763236 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 190/410] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:47 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1557 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:48.401527 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-eac31e65-78de-4208-ba48-a5f09ad00c95 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:48.403371 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-eac31e65-78de-4208-ba48-a5f09ad00c95 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:48.437881 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eac31e65-78de-4208-ba48-a5f09ad00c95 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:48.439108 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eac31e65-78de-4208-ba48-a5f09ad00c95 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:48.443568 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eac31e65-78de-4208-ba48-a5f09ad00c95 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:48.447760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eac31e65-78de-4208-ba48-a5f09ad00c95 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:48.508293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:48.509205 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:48.517421 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:48.521439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:48.522875 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:48.524547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:48.840183 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-eac31e65-78de-4208-ba48-a5f09ad00c95 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:48.868906 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-eac31e65-78de-4208-ba48-a5f09ad00c95 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.472505 Jan 28 01:00:48.883773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 221/411] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:48 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:48.918421 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-acc82598-96f4-4db6-bac5-b2ad818f244e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:48.930089 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-acc82598-96f4-4db6-bac5-b2ad818f244e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:48.942274 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acc82598-96f4-4db6-bac5-b2ad818f244e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:48.953530 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acc82598-96f4-4db6-bac5-b2ad818f244e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:48.954549 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acc82598-96f4-4db6-bac5-b2ad818f244e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:48.955109 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acc82598-96f4-4db6-bac5-b2ad818f244e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:49.518022 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-acc82598-96f4-4db6-bac5-b2ad818f244e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:49.546869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-acc82598-96f4-4db6-bac5-b2ad818f244e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1557 microversion: 2.1 time: 0.651610 Jan 28 01:00:49.549729 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 222/412] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:48 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1557 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:49.773345 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:49.819253 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:49.826922 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:49.830341 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2334a5f8-c840-48c4-a6f1-35045f099001 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 1.325589 Jan 28 01:00:49.842665 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 191/413] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:48 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:49.891563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-34d0422c-99da-4699-867f-11ae966318ab tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:49.892471 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-34d0422c-99da-4699-867f-11ae966318ab tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:49.905985 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-34d0422c-99da-4699-867f-11ae966318ab tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:49.907361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-34d0422c-99da-4699-867f-11ae966318ab tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:49.908513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-34d0422c-99da-4699-867f-11ae966318ab tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:49.909044 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-34d0422c-99da-4699-867f-11ae966318ab tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:50.581517 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ffc20a73-b2b9-450d-a0fb-4398d609c9cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:50.582507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ffc20a73-b2b9-450d-a0fb-4398d609c9cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:50.599474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ffc20a73-b2b9-450d-a0fb-4398d609c9cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:50.600786 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ffc20a73-b2b9-450d-a0fb-4398d609c9cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:50.617756 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ffc20a73-b2b9-450d-a0fb-4398d609c9cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:50.620373 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ffc20a73-b2b9-450d-a0fb-4398d609c9cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:50.725038 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-34d0422c-99da-4699-867f-11ae966318ab tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:50.739518 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-34d0422c-99da-4699-867f-11ae966318ab tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.851979 Jan 28 01:00:50.740644 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 223/414] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:49 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:50.863841 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:50.865469 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:50.891781 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:50.896569 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:50.898608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:50.904790 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:50.965721 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ffc20a73-b2b9-450d-a0fb-4398d609c9cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:50.996160 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ffc20a73-b2b9-450d-a0fb-4398d609c9cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1557 microversion: 2.1 time: 0.415472 Jan 28 01:00:51.026243 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 192/415] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:50 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1557 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:51.409109 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:51.418950 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:51.420501 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:51.421709 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fb3e6ab7-9192-4255-bf43-60c0fa1a4cee tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.563713 Jan 28 01:00:51.422273 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 224/416] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:50 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:51.766944 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7201e477-acc9-4e59-bfc9-ffdfbb4e166e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:51.768265 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7201e477-acc9-4e59-bfc9-ffdfbb4e166e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:51.785957 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7201e477-acc9-4e59-bfc9-ffdfbb4e166e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:51.787685 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7201e477-acc9-4e59-bfc9-ffdfbb4e166e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:51.789811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7201e477-acc9-4e59-bfc9-ffdfbb4e166e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:51.791100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7201e477-acc9-4e59-bfc9-ffdfbb4e166e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:52.033397 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7201e477-acc9-4e59-bfc9-ffdfbb4e166e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:52.036742 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-02a97888-36f5-4703-b761-9d1ff4eec321 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:52.037169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-02a97888-36f5-4703-b761-9d1ff4eec321 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:52.049401 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7201e477-acc9-4e59-bfc9-ffdfbb4e166e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.286581 Jan 28 01:00:52.050087 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 193/417] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:51 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:52.052727 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-02a97888-36f5-4703-b761-9d1ff4eec321 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:52.053193 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-02a97888-36f5-4703-b761-9d1ff4eec321 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:52.054028 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-02a97888-36f5-4703-b761-9d1ff4eec321 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:52.054473 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-02a97888-36f5-4703-b761-9d1ff4eec321 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:52.227642 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-02a97888-36f5-4703-b761-9d1ff4eec321 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:52.236018 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-02a97888-36f5-4703-b761-9d1ff4eec321 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1557 microversion: 2.1 time: 0.209664 Jan 28 01:00:52.236636 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 225/418] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:52 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1557 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:52.442643 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:52.444167 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:52.451825 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:52.452370 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:52.453384 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:52.453820 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:52.643350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:52.656229 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:52.658128 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:52.659995 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e9bc79c4-8a07-40ce-989b-97e5ef55e7ea tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.223732 Jan 28 01:00:52.660535 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 194/419] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:52 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:53.076518 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9eb200eb-87d6-485c-b49c-41c2fb4f5108 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:53.077361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9eb200eb-87d6-485c-b49c-41c2fb4f5108 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:53.084479 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9eb200eb-87d6-485c-b49c-41c2fb4f5108 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:53.085286 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9eb200eb-87d6-485c-b49c-41c2fb4f5108 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:53.086529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9eb200eb-87d6-485c-b49c-41c2fb4f5108 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:53.087333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9eb200eb-87d6-485c-b49c-41c2fb4f5108 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:53.261185 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8aa8b76c-6a51-40b8-9ac8-bc9d35f1b0a0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:53.263572 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8aa8b76c-6a51-40b8-9ac8-bc9d35f1b0a0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:53.283184 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8aa8b76c-6a51-40b8-9ac8-bc9d35f1b0a0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:53.284185 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8aa8b76c-6a51-40b8-9ac8-bc9d35f1b0a0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:53.285648 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8aa8b76c-6a51-40b8-9ac8-bc9d35f1b0a0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:53.286540 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8aa8b76c-6a51-40b8-9ac8-bc9d35f1b0a0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:53.304615 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9eb200eb-87d6-485c-b49c-41c2fb4f5108 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:53.316929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9eb200eb-87d6-485c-b49c-41c2fb4f5108 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.247084 Jan 28 01:00:53.318520 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 226/420] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:53 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:53.501374 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8aa8b76c-6a51-40b8-9ac8-bc9d35f1b0a0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:53.520970 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8aa8b76c-6a51-40b8-9ac8-bc9d35f1b0a0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1557 microversion: 2.1 time: 0.265918 Jan 28 01:00:53.521565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 195/421] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:53 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1557 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:53.688013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:53.689792 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:53.707795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:53.720028 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:53.721696 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:53.722632 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:53.955220 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:53.966142 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:53.967920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:53.969942 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c52399b1-55a5-4885-b237-df8a076d3646 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.289456 Jan 28 01:00:53.983515 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 227/422] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:53 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:54.341863 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-105ee003-f57e-4abb-9c56-11c858844c9e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:54.347735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-105ee003-f57e-4abb-9c56-11c858844c9e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:54.370571 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-105ee003-f57e-4abb-9c56-11c858844c9e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:54.380195 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-105ee003-f57e-4abb-9c56-11c858844c9e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:54.382583 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-105ee003-f57e-4abb-9c56-11c858844c9e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:54.383387 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-105ee003-f57e-4abb-9c56-11c858844c9e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:54.557852 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-039ce42e-189f-427c-a1d0-74366d9a61cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:54.559065 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-039ce42e-189f-427c-a1d0-74366d9a61cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:54.569637 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-039ce42e-189f-427c-a1d0-74366d9a61cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:54.570087 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-039ce42e-189f-427c-a1d0-74366d9a61cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:54.576360 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-039ce42e-189f-427c-a1d0-74366d9a61cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:54.577702 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-039ce42e-189f-427c-a1d0-74366d9a61cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:54.691522 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-105ee003-f57e-4abb-9c56-11c858844c9e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:54.700541 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-105ee003-f57e-4abb-9c56-11c858844c9e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.365726 Jan 28 01:00:54.702973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 196/423] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:54 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:54.750454 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-551624948", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "networks": [{"uuid": "87529b14-ec97-47b6-b564-089e17ceb8e6"}]}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:54.880441 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] validate_networks() for [('87529b14-ec97-47b6-b564-089e17ceb8e6', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:00:54.980586 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-039ce42e-189f-427c-a1d0-74366d9a61cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:55.010114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-039ce42e-189f-427c-a1d0-74366d9a61cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1557 microversion: 2.1 time: 0.460736 Jan 28 01:00:55.018729 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 228/424] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:54 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1557 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:55.036310 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:55.040579 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:55.069506 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:55.070379 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:55.072076 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:55.072823 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:55.301542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:55.311206 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:55.313246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:55.315129 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ad3897b7-42fe-48e0-9e2d-0d7c801bfff5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.294884 Jan 28 01:00:55.315940 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 229/425] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:55 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:55.530182 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:00:55.531772 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:00:55.532785 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:00:55.533698 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:00:55.534535 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:00:55.560557 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:55.563870 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:55.567546 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:55.586848 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:55.621961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Getting quotas for project 5aa12e9e43b74e37b418bbc4806a875c. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:00:55.627420 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Getting quotas for user 765eed67607c4ffeb858eda201f9be4a and project 5aa12e9e43b74e37b418bbc4806a875c. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:00:55.672045 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:00:55.679740 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:00:55.729694 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2f2ad6c2-76ae-4c68-9253-9f245e59ab2e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:55.740762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2f2ad6c2-76ae-4c68-9253-9f245e59ab2e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:55.756998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2f2ad6c2-76ae-4c68-9253-9f245e59ab2e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:55.758224 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2f2ad6c2-76ae-4c68-9253-9f245e59ab2e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:55.759403 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2f2ad6c2-76ae-4c68-9253-9f245e59ab2e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:55.760008 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2f2ad6c2-76ae-4c68-9253-9f245e59ab2e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:55.802877 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2e6cdf3c-e365-416f-9e63-f7ffd4c733db tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056360 Jan 28 01:00:55.811282 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 197/426] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:00:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:00:55.816260 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7445915f-28d9-422b-bf85-a9a109a94fe4 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:55.816893 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7445915f-28d9-422b-bf85-a9a109a94fe4 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:56.002183 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7445915f-28d9-422b-bf85-a9a109a94fe4 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:56.009977 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7445915f-28d9-422b-bf85-a9a109a94fe4 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1218 microversion: 2.1 time: 0.197535 Jan 28 01:00:56.020577 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 198/427] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:55 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:56.059450 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-94e150ba-3588-444b-bbeb-e3ee931cdb2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:56.060107 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-94e150ba-3588-444b-bbeb-e3ee931cdb2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:56.070970 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-94e150ba-3588-444b-bbeb-e3ee931cdb2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:56.072709 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-94e150ba-3588-444b-bbeb-e3ee931cdb2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:56.073841 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-94e150ba-3588-444b-bbeb-e3ee931cdb2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:56.075078 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-94e150ba-3588-444b-bbeb-e3ee931cdb2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:56.164349 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2f2ad6c2-76ae-4c68-9253-9f245e59ab2e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:56.176121 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2f2ad6c2-76ae-4c68-9253-9f245e59ab2e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.453073 Jan 28 01:00:56.180945 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 230/428] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:55 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:56.294190 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-94e150ba-3588-444b-bbeb-e3ee931cdb2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:56.306316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-94e150ba-3588-444b-bbeb-e3ee931cdb2b tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1563 microversion: 2.1 time: 0.264083 Jan 28 01:00:56.318432 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 199/429] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:56 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1563 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:56.334361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:56.335017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:56.343948 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:56.344529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:56.345350 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:56.345797 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:56.421101 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-85c895a8-4545-4feb-8a97-56290e24dc72 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:56.421627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-85c895a8-4545-4feb-8a97-56290e24dc72 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:56.430288 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-85c895a8-4545-4feb-8a97-56290e24dc72 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:56.430746 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-85c895a8-4545-4feb-8a97-56290e24dc72 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:56.431646 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-85c895a8-4545-4feb-8a97-56290e24dc72 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:56.432089 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-85c895a8-4545-4feb-8a97-56290e24dc72 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:56.705459 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:56.737248 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:56.748656 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:56.750740 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ef79580b-7da6-4cf0-b150-e69d7fbe2f27 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.420801 Jan 28 01:00:56.768059 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 231/430] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:56 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:00:56.828843 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-85c895a8-4545-4feb-8a97-56290e24dc72 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'services' on Instance uuid 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:00:56.961818 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-7d9880d8-a744-432e-8fa8-01738505623e req-48b11571-b8f3-41f6-bbf1-b02d832c9622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd356939-ae04-408e-ba0a-bb9bf12d7a36", "name": "network-vif-plugged", "status": "completed", "tag": "43cbe1a5-2a85-4721-8c67-6ae16336682b"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:56.965162 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:56.965162 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:00:57.001029 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-7d9880d8-a744-432e-8fa8-01738505623e req-48b11571-b8f3-41f6-bbf1-b02d832c9622 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:57.001936 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-7d9880d8-a744-432e-8fa8-01738505623e req-48b11571-b8f3-41f6-bbf1-b02d832c9622 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:57.053013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-7d9880d8-a744-432e-8fa8-01738505623e req-48b11571-b8f3-41f6-bbf1-b02d832c9622 service nova] Creating event network-vif-plugged:43cbe1a5-2a85-4721-8c67-6ae16336682b for instance dd356939-ae04-408e-ba0a-bb9bf12d7a36 on hv-cinder-81689 Jan 28 01:00:57.072789 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-7d9880d8-a744-432e-8fa8-01738505623e req-48b11571-b8f3-41f6-bbf1-b02d832c9622 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112802 Jan 28 01:00:57.075201 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 232/431] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:00:57.088547 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e49dbc60-fb5f-4dd7-a62a-70734221d8e7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:57.090177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e49dbc60-fb5f-4dd7-a62a-70734221d8e7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:57.141633 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e49dbc60-fb5f-4dd7-a62a-70734221d8e7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:57.145796 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e49dbc60-fb5f-4dd7-a62a-70734221d8e7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:57.147696 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e49dbc60-fb5f-4dd7-a62a-70734221d8e7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:57.155775 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e49dbc60-fb5f-4dd7-a62a-70734221d8e7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:57.168605 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-85c895a8-4545-4feb-8a97-56290e24dc72 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "DELETE /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments/7e199043-cef6-4f9d-862b-bd6b0bacda7b" status: 202 len: 0 microversion: 2.1 time: 0.749542 Jan 28 01:00:57.173641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 200/432] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:00:56 2022] DELETE /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments/7e199043-cef6-4f9d-862b-bd6b0bacda7b => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:00:57.204143 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-78280c7d-8b58-4778-91ab-6a02b966f8f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:57.208791 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-78280c7d-8b58-4778-91ab-6a02b966f8f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:57.238681 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-78280c7d-8b58-4778-91ab-6a02b966f8f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:57.244727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-78280c7d-8b58-4778-91ab-6a02b966f8f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:57.246611 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-78280c7d-8b58-4778-91ab-6a02b966f8f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:57.248572 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-78280c7d-8b58-4778-91ab-6a02b966f8f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:57.359437 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-78280c7d-8b58-4778-91ab-6a02b966f8f9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178293 Jan 28 01:00:57.361654 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 201/433] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:00:57 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:57.372775 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d3e4cf43-5d11-40d6-b760-28313733fc6a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:57.373781 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d3e4cf43-5d11-40d6-b760-28313733fc6a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:57.383231 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d3e4cf43-5d11-40d6-b760-28313733fc6a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:57.384063 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d3e4cf43-5d11-40d6-b760-28313733fc6a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:57.385662 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d3e4cf43-5d11-40d6-b760-28313733fc6a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:57.386297 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d3e4cf43-5d11-40d6-b760-28313733fc6a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:57.415709 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e49dbc60-fb5f-4dd7-a62a-70734221d8e7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:57.433061 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e49dbc60-fb5f-4dd7-a62a-70734221d8e7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1214 microversion: 2.1 time: 0.355878 Jan 28 01:00:57.434192 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 233/434] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:57 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1214 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:57.680948 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d3e4cf43-5d11-40d6-b760-28313733fc6a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:57.688838 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d3e4cf43-5d11-40d6-b760-28313733fc6a tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.325405 Jan 28 01:00:57.689419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 202/435] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:57 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:57.776094 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:57.777559 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:57.784002 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:57.787186 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:57.788345 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:57.788857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:57.975458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:57.989911 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:57.992630 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:57.994198 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-87ab0b6a-cbe9-4120-94fd-0540b792584b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.222121 Jan 28 01:00:58.005506 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 234/436] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:57 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:58.378147 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3321a979-bd55-4249-b50a-e1e93baabe1e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:58.380807 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3321a979-bd55-4249-b50a-e1e93baabe1e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:58.400638 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3321a979-bd55-4249-b50a-e1e93baabe1e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:58.401413 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3321a979-bd55-4249-b50a-e1e93baabe1e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:58.402859 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3321a979-bd55-4249-b50a-e1e93baabe1e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:58.403673 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3321a979-bd55-4249-b50a-e1e93baabe1e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:58.464287 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3321a979-bd55-4249-b50a-e1e93baabe1e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092597 Jan 28 01:00:58.469601 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1a73d53d-b68d-489c-a7f8-dd872d977255 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:58.469989 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 203/437] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:00:58 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:00:58.471212 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1a73d53d-b68d-489c-a7f8-dd872d977255 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:58.488361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a73d53d-b68d-489c-a7f8-dd872d977255 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:58.493660 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a73d53d-b68d-489c-a7f8-dd872d977255 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:58.495474 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a73d53d-b68d-489c-a7f8-dd872d977255 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:58.496547 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a73d53d-b68d-489c-a7f8-dd872d977255 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:58.604786 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1a73d53d-b68d-489c-a7f8-dd872d977255 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:58.616737 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1a73d53d-b68d-489c-a7f8-dd872d977255 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1270 microversion: 2.1 time: 0.166798 Jan 28 01:00:58.627354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 235/438] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:58 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:58.716630 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-af539f28-dd45-47b1-bdc0-f2e6dc01958e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:58.717320 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-af539f28-dd45-47b1-bdc0-f2e6dc01958e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:58.747330 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-af539f28-dd45-47b1-bdc0-f2e6dc01958e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:58.747842 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-af539f28-dd45-47b1-bdc0-f2e6dc01958e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:58.752679 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-af539f28-dd45-47b1-bdc0-f2e6dc01958e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:58.753322 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-af539f28-dd45-47b1-bdc0-f2e6dc01958e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:59.013896 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:59.015500 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:59.034783 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:59.036417 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:59.039778 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:59.042149 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:59.336736 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:59.360788 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:59.365662 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:59.369246 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-af539f28-dd45-47b1-bdc0-f2e6dc01958e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:59.373456 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b62e6167-b325-45b6-b6aa-5416605d5e0c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.362782 Jan 28 01:00:59.378449 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 236/439] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:00:59 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:00:59.382060 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-af539f28-dd45-47b1-bdc0-f2e6dc01958e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1313 microversion: 2.1 time: 0.675170 Jan 28 01:00:59.382995 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 204/440] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:58 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:59.483504 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a9b417d4-687d-4415-96bd-37875c7d1d09 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:59.485786 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a9b417d4-687d-4415-96bd-37875c7d1d09 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:59.497604 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a9b417d4-687d-4415-96bd-37875c7d1d09 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:59.498493 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a9b417d4-687d-4415-96bd-37875c7d1d09 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:59.499468 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a9b417d4-687d-4415-96bd-37875c7d1d09 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:59.500000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a9b417d4-687d-4415-96bd-37875c7d1d09 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:59.553243 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a9b417d4-687d-4415-96bd-37875c7d1d09 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078851 Jan 28 01:00:59.554736 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 237/441] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:00:59 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:00:59.640807 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-54042d03-2b27-4228-a864-d8690ae8b6a7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:59.643671 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-54042d03-2b27-4228-a864-d8690ae8b6a7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:59.671196 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54042d03-2b27-4228-a864-d8690ae8b6a7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:59.672307 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54042d03-2b27-4228-a864-d8690ae8b6a7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:59.674047 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54042d03-2b27-4228-a864-d8690ae8b6a7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:59.675297 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54042d03-2b27-4228-a864-d8690ae8b6a7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:59.876484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-54042d03-2b27-4228-a864-d8690ae8b6a7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:59.902710 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-54042d03-2b27-4228-a864-d8690ae8b6a7 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1276 microversion: 2.1 time: 0.268381 Jan 28 01:00:59.907850 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 205/442] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:59 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1276 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:00.395451 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-6efe0371-3c62-4a80-afa5-4893ebbf6303 req-ae91ef8c-62ac-492c-94d2-7de6a3665c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ab5025-62f7-40d2-b976-95ed4c6f0499", "name": "network-vif-plugged", "status": "completed", "tag": "4018b024-2307-4179-b2ef-10369aaee53c"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:00.397197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:00.397197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:01:00.401510 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5adbf7eb-2771-4a5b-8124-d9986cf6178e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:00.402971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5adbf7eb-2771-4a5b-8124-d9986cf6178e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:00.408016 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-6efe0371-3c62-4a80-afa5-4893ebbf6303 req-ae91ef8c-62ac-492c-94d2-7de6a3665c35 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.408872 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-6efe0371-3c62-4a80-afa5-4893ebbf6303 req-ae91ef8c-62ac-492c-94d2-7de6a3665c35 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.425768 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-6efe0371-3c62-4a80-afa5-4893ebbf6303 req-ae91ef8c-62ac-492c-94d2-7de6a3665c35 service nova] Creating event network-vif-plugged:4018b024-2307-4179-b2ef-10369aaee53c for instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 on hv-cinder-81689 Jan 28 01:01:00.435240 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-6efe0371-3c62-4a80-afa5-4893ebbf6303 req-ae91ef8c-62ac-492c-94d2-7de6a3665c35 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043107 Jan 28 01:01:00.436716 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 238/443] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:00.438513 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5adbf7eb-2771-4a5b-8124-d9986cf6178e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.438999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5adbf7eb-2771-4a5b-8124-d9986cf6178e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.441077 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5adbf7eb-2771-4a5b-8124-d9986cf6178e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.443349 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:00.443703 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5adbf7eb-2771-4a5b-8124-d9986cf6178e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.444788 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:00.454386 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.455157 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.456534 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.458922 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.665267 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:00.677025 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:00.680401 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:00.681772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5d8dff5e-e2d0-4cac-ba2b-f06c9a682a40 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.243562 Jan 28 01:01:00.682449 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 239/444] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:01:00 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:01:00.934116 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2d16fea4-5bd7-407d-a9ec-3991394a0d5e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:00.934933 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2d16fea4-5bd7-407d-a9ec-3991394a0d5e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:00.950522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d16fea4-5bd7-407d-a9ec-3991394a0d5e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.951498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d16fea4-5bd7-407d-a9ec-3991394a0d5e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.955823 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d16fea4-5bd7-407d-a9ec-3991394a0d5e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.957129 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d16fea4-5bd7-407d-a9ec-3991394a0d5e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:01.043921 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5adbf7eb-2771-4a5b-8124-d9986cf6178e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:01.056505 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5adbf7eb-2771-4a5b-8124-d9986cf6178e tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1498 microversion: 2.1 time: 0.660384 Jan 28 01:01:01.060331 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 206/445] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:00 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1498 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:01.269818 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2d16fea4-5bd7-407d-a9ec-3991394a0d5e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:01.283273 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2d16fea4-5bd7-407d-a9ec-3991394a0d5e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.354376 Jan 28 01:01:01.284317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 240/446] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:00 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:01.703618 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:01.704367 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:01.712031 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:01.712992 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:01.714200 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:01.715233 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:01.931693 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b2389fcc-b0ba-4a81-94c2-496474eaa913 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:01.934468 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b2389fcc-b0ba-4a81-94c2-496474eaa913 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:01.946015 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b2389fcc-b0ba-4a81-94c2-496474eaa913 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:01.947421 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b2389fcc-b0ba-4a81-94c2-496474eaa913 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:01.948409 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b2389fcc-b0ba-4a81-94c2-496474eaa913 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:01.949079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b2389fcc-b0ba-4a81-94c2-496474eaa913 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:01.974875 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:01.983864 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b2389fcc-b0ba-4a81-94c2-496474eaa913 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Going to try to terminate instance {{(pid=116254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:01:01.994491 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:01.998704 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:02.000959 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b9dbc16e-60b0-4fca-994c-56de35912284 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.302973 Jan 28 01:01:02.011923 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 207/447] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:01:01 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:01:02.073684 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-6e52892b-cbc2-4b0f-a2df-b9dd8b946f6e req-2b6820da-a211-45d1-ab53-75fdb4f3d54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30cc0552-4336-498f-b444-cc4e6338c62f", "tag": "2994a10b-5228-441d-8734-936c3bea9193"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:02.076047 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:02.076047 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:01:02.088707 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-6e52892b-cbc2-4b0f-a2df-b9dd8b946f6e req-2b6820da-a211-45d1-ab53-75fdb4f3d54e service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.089589 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-6e52892b-cbc2-4b0f-a2df-b9dd8b946f6e req-2b6820da-a211-45d1-ab53-75fdb4f3d54e service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.107395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-6e52892b-cbc2-4b0f-a2df-b9dd8b946f6e req-2b6820da-a211-45d1-ab53-75fdb4f3d54e service nova] Creating event network-changed:2994a10b-5228-441d-8734-936c3bea9193 for instance 30cc0552-4336-498f-b444-cc4e6338c62f on hv-cinder-81689 Jan 28 01:01:02.123350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-6e52892b-cbc2-4b0f-a2df-b9dd8b946f6e req-2b6820da-a211-45d1-ab53-75fdb4f3d54e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054355 Jan 28 01:01:02.124730 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 208/448] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:01:02.129720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b2389fcc-b0ba-4a81-94c2-496474eaa913 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 204 len: 0 microversion: 2.1 time: 0.204560 Jan 28 01:01:02.131619 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 241/449] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:01:01 2022] DELETE /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 01:01:02.141032 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-93574125-ac61-4ff1-898e-a46a36450dfe tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:02.142083 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-93574125-ac61-4ff1-898e-a46a36450dfe tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:02.149385 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93574125-ac61-4ff1-898e-a46a36450dfe tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.150018 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93574125-ac61-4ff1-898e-a46a36450dfe tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.151114 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93574125-ac61-4ff1-898e-a46a36450dfe tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.151782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93574125-ac61-4ff1-898e-a46a36450dfe tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.317795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f72103f5-10df-4188-b60f-9be461697773 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:02.321570 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f72103f5-10df-4188-b60f-9be461697773 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:02.379815 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f72103f5-10df-4188-b60f-9be461697773 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.380718 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f72103f5-10df-4188-b60f-9be461697773 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.386043 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f72103f5-10df-4188-b60f-9be461697773 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.390529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f72103f5-10df-4188-b60f-9be461697773 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.615194 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-93574125-ac61-4ff1-898e-a46a36450dfe tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:02.630799 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-93574125-ac61-4ff1-898e-a46a36450dfe tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1504 microversion: 2.1 time: 0.494074 Jan 28 01:01:02.631825 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 209/450] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:02 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:02.640467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-31c08260-6533-4705-968c-063cb8ca0859 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:02.641400 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-31c08260-6533-4705-968c-063cb8ca0859 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:02.652867 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-31c08260-6533-4705-968c-063cb8ca0859 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.654045 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-31c08260-6533-4705-968c-063cb8ca0859 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.655716 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-31c08260-6533-4705-968c-063cb8ca0859 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.657059 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-31c08260-6533-4705-968c-063cb8ca0859 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.677240 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f72103f5-10df-4188-b60f-9be461697773 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:02.693579 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f72103f5-10df-4188-b60f-9be461697773 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.387310 Jan 28 01:01:02.694643 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 242/451] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:02 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:02.726616 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-31c08260-6533-4705-968c-063cb8ca0859 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:01:02.847709 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-31c08260-6533-4705-968c-063cb8ca0859 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "DELETE /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 204 len: 0 microversion: 2.1 time: 0.214030 Jan 28 01:01:02.848309 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 210/452] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:01:02 2022] DELETE /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:01:02.856998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8587afdf-ba2c-4f3a-a06a-f41d31aebac6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:02.857718 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8587afdf-ba2c-4f3a-a06a-f41d31aebac6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:02.872169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8587afdf-ba2c-4f3a-a06a-f41d31aebac6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.872169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8587afdf-ba2c-4f3a-a06a-f41d31aebac6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.872169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8587afdf-ba2c-4f3a-a06a-f41d31aebac6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.873359 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8587afdf-ba2c-4f3a-a06a-f41d31aebac6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:03.028705 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:03.029419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:03.044983 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:03.045442 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:03.046258 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:03.046701 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:03.100123 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8587afdf-ba2c-4f3a-a06a-f41d31aebac6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:03.113500 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8587afdf-ba2c-4f3a-a06a-f41d31aebac6 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1509 microversion: 2.1 time: 0.260493 Jan 28 01:01:03.114937 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 243/453] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:02 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1509 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:03.338767 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:03.352072 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:03.354504 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:03.356690 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ff3d98d2-5528-4eba-90a6-30d5791aabdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1808 microversion: 2.20 time: 0.331799 Jan 28 01:01:03.374452 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 211/454] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:01:03 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:01:03.649106 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-801c55a5-a734-467e-a1af-16f263cb8f64 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:03.650092 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-801c55a5-a734-467e-a1af-16f263cb8f64 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:03.663492 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-801c55a5-a734-467e-a1af-16f263cb8f64 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:03.664265 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-801c55a5-a734-467e-a1af-16f263cb8f64 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:03.665247 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-801c55a5-a734-467e-a1af-16f263cb8f64 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:03.665847 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-801c55a5-a734-467e-a1af-16f263cb8f64 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:03.718452 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5f991000-c085-4356-b6bb-733245c0e7d9 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:03.719434 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5f991000-c085-4356-b6bb-733245c0e7d9 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:03.733568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f991000-c085-4356-b6bb-733245c0e7d9 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:03.745891 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f991000-c085-4356-b6bb-733245c0e7d9 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:03.747043 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f991000-c085-4356-b6bb-733245c0e7d9 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:03.747650 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f991000-c085-4356-b6bb-733245c0e7d9 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:03.913712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-801c55a5-a734-467e-a1af-16f263cb8f64 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:03.923860 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-801c55a5-a734-467e-a1af-16f263cb8f64 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1504 microversion: 2.1 time: 0.278677 Jan 28 01:01:03.937449 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 244/455] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:03 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:03.994369 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5f991000-c085-4356-b6bb-733245c0e7d9 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:04.005047 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5f991000-c085-4356-b6bb-733245c0e7d9 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.290708 Jan 28 01:01:04.006007 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 212/456] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:03 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:04.138139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-dab4f437-af37-40c1-938d-b825f213fc96 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:04.138787 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-dab4f437-af37-40c1-938d-b825f213fc96 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:04.147284 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dab4f437-af37-40c1-938d-b825f213fc96 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:04.148282 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dab4f437-af37-40c1-938d-b825f213fc96 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:04.149268 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dab4f437-af37-40c1-938d-b825f213fc96 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:04.149721 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dab4f437-af37-40c1-938d-b825f213fc96 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:04.372259 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-dab4f437-af37-40c1-938d-b825f213fc96 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:04.388293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:04.389375 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:04.393012 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-dab4f437-af37-40c1-938d-b825f213fc96 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1509 microversion: 2.1 time: 0.258973 Jan 28 01:01:04.394091 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 245/457] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:04 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:04.403802 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:04.404348 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:04.405251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:04.405817 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:04.693817 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:04.713319 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:04.715985 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:04.717608 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6422a1af-8de5-4464-a67f-df8752311664 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1795 microversion: 2.20 time: 0.336245 Jan 28 01:01:04.718387 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 213/458] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:01:04 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1795 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:01:04.932382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-fe16bddf-7f99-4bc9-86a5-c0e608a7fb09 req-6893c4e2-b2ee-46bd-8180-d1d03de4f5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd356939-ae04-408e-ba0a-bb9bf12d7a36", "name": "network-vif-deleted", "tag": "43cbe1a5-2a85-4721-8c67-6ae16336682b"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:04.935083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:04.935083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:01:04.942419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1c0bfe98-1c4f-432f-ad14-b4c1d2aa9732 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:04.943237 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1c0bfe98-1c4f-432f-ad14-b4c1d2aa9732 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:04.959561 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1c0bfe98-1c4f-432f-ad14-b4c1d2aa9732 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:04.964153 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1c0bfe98-1c4f-432f-ad14-b4c1d2aa9732 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:04.966318 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1c0bfe98-1c4f-432f-ad14-b4c1d2aa9732 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:04.967183 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-fe16bddf-7f99-4bc9-86a5-c0e608a7fb09 req-6893c4e2-b2ee-46bd-8180-d1d03de4f5d8 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:04.967901 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1c0bfe98-1c4f-432f-ad14-b4c1d2aa9732 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:04.968578 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-fe16bddf-7f99-4bc9-86a5-c0e608a7fb09 req-6893c4e2-b2ee-46bd-8180-d1d03de4f5d8 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:04.996609 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-fe16bddf-7f99-4bc9-86a5-c0e608a7fb09 req-6893c4e2-b2ee-46bd-8180-d1d03de4f5d8 service nova] Creating event network-vif-deleted:43cbe1a5-2a85-4721-8c67-6ae16336682b for instance dd356939-ae04-408e-ba0a-bb9bf12d7a36 on hv-cinder-81689 Jan 28 01:01:05.005402 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-fe16bddf-7f99-4bc9-86a5-c0e608a7fb09 req-6893c4e2-b2ee-46bd-8180-d1d03de4f5d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077164 Jan 28 01:01:05.013059 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 246/459] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:05.043373 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9b0825bb-adfb-4120-8b6d-4e0af9c4c321 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:05.045784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9b0825bb-adfb-4120-8b6d-4e0af9c4c321 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:05.064607 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b0825bb-adfb-4120-8b6d-4e0af9c4c321 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:05.066582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b0825bb-adfb-4120-8b6d-4e0af9c4c321 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:05.069418 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b0825bb-adfb-4120-8b6d-4e0af9c4c321 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:05.071200 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b0825bb-adfb-4120-8b6d-4e0af9c4c321 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:05.092540 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1c0bfe98-1c4f-432f-ad14-b4c1d2aa9732 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '256021e079304993a03de9232cba80e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65c173bb6e2e4edba095bbd06228bbc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:05.111989 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1c0bfe98-1c4f-432f-ad14-b4c1d2aa9732 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 200 len: 1298 microversion: 2.1 time: 0.172933 Jan 28 01:01:05.122108 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 214/460] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:04 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 1298 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:05.298358 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9b0825bb-adfb-4120-8b6d-4e0af9c4c321 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:05.312266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9b0825bb-adfb-4120-8b6d-4e0af9c4c321 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.276687 Jan 28 01:01:05.313724 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 247/461] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:05 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:05.417862 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-fb0cb3eb-2e4c-4938-bcb3-6b0d1b12922c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:05.418744 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-fb0cb3eb-2e4c-4938-bcb3-6b0d1b12922c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:05.437049 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fb0cb3eb-2e4c-4938-bcb3-6b0d1b12922c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:05.438085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fb0cb3eb-2e4c-4938-bcb3-6b0d1b12922c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:05.439515 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fb0cb3eb-2e4c-4938-bcb3-6b0d1b12922c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:05.440708 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fb0cb3eb-2e4c-4938-bcb3-6b0d1b12922c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:05.674662 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-fb0cb3eb-2e4c-4938-bcb3-6b0d1b12922c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:05.699408 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-fb0cb3eb-2e4c-4938-bcb3-6b0d1b12922c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1509 microversion: 2.1 time: 0.290910 Jan 28 01:01:05.701743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 215/462] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:05 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:06.142194 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c7be21c0-5746-4660-8a64-f7c0645c7b19 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:06.151457 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c7be21c0-5746-4660-8a64-f7c0645c7b19 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] [instance: dd356939-ae04-408e-ba0a-bb9bf12d7a36] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:06.169834 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7be21c0-5746-4660-8a64-f7c0645c7b19 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:06.170581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7be21c0-5746-4660-8a64-f7c0645c7b19 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:06.177227 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7be21c0-5746-4660-8a64-f7c0645c7b19 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:06.177886 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7be21c0-5746-4660-8a64-f7c0645c7b19 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:06.215206 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-c7be21c0-5746-4660-8a64-f7c0645c7b19 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] HTTP exception thrown: Instance dd356939-ae04-408e-ba0a-bb9bf12d7a36 could not be found. Jan 28 01:01:06.220337 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c7be21c0-5746-4660-8a64-f7c0645c7b19 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] Returning 404 to user: Instance dd356939-ae04-408e-ba0a-bb9bf12d7a36 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:01:06.221972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c7be21c0-5746-4660-8a64-f7c0645c7b19 tempest-VolumesActionsTest-2011200008 tempest-VolumesActionsTest-2011200008-project] 10.222.0.78 "GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36" status: 404 len: 111 microversion: 2.1 time: 0.087303 Jan 28 01:01:06.241541 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 248/463] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:06 2022] GET /compute/v2.1/servers/dd356939-ae04-408e-ba0a-bb9bf12d7a36 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:01:06.337674 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-19e8e74f-a985-4747-8ae7-d01a057a30a5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:06.339933 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-19e8e74f-a985-4747-8ae7-d01a057a30a5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:06.355835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-19e8e74f-a985-4747-8ae7-d01a057a30a5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:06.358665 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-19e8e74f-a985-4747-8ae7-d01a057a30a5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:06.359756 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-19e8e74f-a985-4747-8ae7-d01a057a30a5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:06.362470 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-19e8e74f-a985-4747-8ae7-d01a057a30a5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:06.722588 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-90fd6513-4ddb-4601-937c-49ac1f516239 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:06.723519 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-90fd6513-4ddb-4601-937c-49ac1f516239 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:06.736762 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-19e8e74f-a985-4747-8ae7-d01a057a30a5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:06.747605 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-19e8e74f-a985-4747-8ae7-d01a057a30a5 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.418243 Jan 28 01:01:06.748610 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 216/464] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:06 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:06.753194 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-90fd6513-4ddb-4601-937c-49ac1f516239 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:06.754052 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-90fd6513-4ddb-4601-937c-49ac1f516239 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:06.755250 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-90fd6513-4ddb-4601-937c-49ac1f516239 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:06.755879 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-90fd6513-4ddb-4601-937c-49ac1f516239 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:07.053315 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-90fd6513-4ddb-4601-937c-49ac1f516239 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:07.072117 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-90fd6513-4ddb-4601-937c-49ac1f516239 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1509 microversion: 2.1 time: 0.355679 Jan 28 01:01:07.084943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 249/465] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:06 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1509 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:07.107526 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-fa2bf49f-4e09-46f4-a4d6-001927ae1f85 req-0507ba42-cb34-4dda-9a55-4028b22c67d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "213c2110-983e-47cc-b98c-6b8b91a5e7a3", "name": "network-vif-deleted", "tag": "450ff6d4-7d9c-4d30-9b72-a587ed2801cc"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:07.108598 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:07.108598 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:01:07.130012 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-fa2bf49f-4e09-46f4-a4d6-001927ae1f85 req-0507ba42-cb34-4dda-9a55-4028b22c67d9 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:07.130831 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-fa2bf49f-4e09-46f4-a4d6-001927ae1f85 req-0507ba42-cb34-4dda-9a55-4028b22c67d9 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:07.163711 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-fa2bf49f-4e09-46f4-a4d6-001927ae1f85 req-0507ba42-cb34-4dda-9a55-4028b22c67d9 service nova] Creating event network-vif-deleted:450ff6d4-7d9c-4d30-9b72-a587ed2801cc for instance 213c2110-983e-47cc-b98c-6b8b91a5e7a3 on hv-cinder-81689 Jan 28 01:01:07.176049 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-fa2bf49f-4e09-46f4-a4d6-001927ae1f85 req-0507ba42-cb34-4dda-9a55-4028b22c67d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073044 Jan 28 01:01:07.178909 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 217/466] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:07.318057 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4fd27f44-dea3-43e1-8fad-a1ff8083bd22 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Action: 'create', calling method: .version_select at 0x7f1a09490ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-633210491"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:07.343901 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-4fd27f44-dea3-43e1-8fad-a1ff8083bd22 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Getting quotas for project e43c3f3031ee40508283209d12740ec8. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:01:07.348622 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-4fd27f44-dea3-43e1-8fad-a1ff8083bd22 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Getting quotas for user 939861de833b40df9d98e0e090cbb85a and project e43c3f3031ee40508283209d12740ec8. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:01:07.611239 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-4fd27f44-dea3-43e1-8fad-a1ff8083bd22 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Getting quotas for project e43c3f3031ee40508283209d12740ec8. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:01:07.618924 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-4fd27f44-dea3-43e1-8fad-a1ff8083bd22 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Getting quotas for user 939861de833b40df9d98e0e090cbb85a and project e43c3f3031ee40508283209d12740ec8. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:01:07.633877 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4fd27f44-dea3-43e1-8fad-a1ff8083bd22 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.323018 Jan 28 01:01:07.634482 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 250/467] 10.222.0.78 () {60 vars in 1157 bytes} [Fri Jan 28 01:01:07 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:07.703553 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1954846207", "imageRef": "23cc8b47-4af9-4f9f-a363-ef3ae4f16517", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-633210491", "networks": [{"uuid": "56cdaf8a-2aaa-4802-bf7a-e7fc18698832"}]}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:07.765221 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] validate_networks() for [('56cdaf8a-2aaa-4802-bf7a-e7fc18698832', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:01:07.766364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-203a5498-8967-4723-ac74-5ca5ee2012bc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:07.767233 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-203a5498-8967-4723-ac74-5ca5ee2012bc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:07.774741 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-203a5498-8967-4723-ac74-5ca5ee2012bc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:07.775390 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-203a5498-8967-4723-ac74-5ca5ee2012bc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:07.776399 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-203a5498-8967-4723-ac74-5ca5ee2012bc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:07.777529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-203a5498-8967-4723-ac74-5ca5ee2012bc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:07.955665 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-203a5498-8967-4723-ac74-5ca5ee2012bc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:07.964047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-203a5498-8967-4723-ac74-5ca5ee2012bc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.202048 Jan 28 01:01:07.964047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 251/468] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:07 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:08.089551 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:08.090169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:08.096264 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:08.096724 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:08.097527 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:08.097972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:08.131665 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:08.132120 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:08.132581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'fault' on Instance uuid 213c2110-983e-47cc-b98c-6b8b91a5e7a3 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:08.183646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:08.192262 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-30c70b93-7df0-46e4-8155-9da74d2c51ab tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1312 microversion: 2.1 time: 0.106323 Jan 28 01:01:08.192859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 252/469] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:08 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:08.248675 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:01:08.249753 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:01:08.250205 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:01:08.250912 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:01:08.251658 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:01:08.267249 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:08.267759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:08.268610 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:08.269059 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:08.287101 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Getting quotas for project e43c3f3031ee40508283209d12740ec8. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:01:08.294584 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Getting quotas for user 939861de833b40df9d98e0e090cbb85a and project e43c3f3031ee40508283209d12740ec8. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:01:08.313401 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:01:08.316981 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23cc8b47-4af9-4f9f-a363-ef3ae4f16517',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:01:08.367477 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7972ac5f-5b1b-4d14-8359-7f209e82fda4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672906 Jan 28 01:01:08.373582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 218/470] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:01:08.384870 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a3dc3331-60a0-4482-a1aa-7b4d24cc2583 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:08.385997 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a3dc3331-60a0-4482-a1aa-7b4d24cc2583 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:08.455961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a3dc3331-60a0-4482-a1aa-7b4d24cc2583 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:08.463232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a3dc3331-60a0-4482-a1aa-7b4d24cc2583 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1258 microversion: 2.1 time: 0.085079 Jan 28 01:01:08.464086 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 253/471] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:08 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:08.981296 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2861afd6-56dd-48d7-9d18-ce04dafd8c17 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:08.981915 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2861afd6-56dd-48d7-9d18-ce04dafd8c17 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:08.989261 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2861afd6-56dd-48d7-9d18-ce04dafd8c17 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:08.989716 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2861afd6-56dd-48d7-9d18-ce04dafd8c17 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:08.990506 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2861afd6-56dd-48d7-9d18-ce04dafd8c17 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:08.990982 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2861afd6-56dd-48d7-9d18-ce04dafd8c17 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:09.149960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2861afd6-56dd-48d7-9d18-ce04dafd8c17 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:09.157830 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2861afd6-56dd-48d7-9d18-ce04dafd8c17 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.180870 Jan 28 01:01:09.158402 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 219/472] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:08 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:09.215407 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:09.216372 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:09.222674 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:09.223161 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:09.223943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:09.224383 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:09.263686 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:09.264148 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:09.264580 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'fault' on Instance uuid 213c2110-983e-47cc-b98c-6b8b91a5e7a3 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:09.304974 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:09.313027 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-638c4256-8e4c-405b-88c8-e35eb3aacb6d tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1312 microversion: 2.1 time: 0.102051 Jan 28 01:01:09.313610 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 254/473] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:09 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:09.485903 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-03a509cb-4c8b-44fc-9705-19026f065525 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:09.486824 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-03a509cb-4c8b-44fc-9705-19026f065525 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:09.492871 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03a509cb-4c8b-44fc-9705-19026f065525 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:09.493321 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03a509cb-4c8b-44fc-9705-19026f065525 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:09.494122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03a509cb-4c8b-44fc-9705-19026f065525 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:09.494560 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03a509cb-4c8b-44fc-9705-19026f065525 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:09.573852 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-03a509cb-4c8b-44fc-9705-19026f065525 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:09.585917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-03a509cb-4c8b-44fc-9705-19026f065525 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1262 microversion: 2.1 time: 0.104764 Jan 28 01:01:09.586490 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 220/474] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:09 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1262 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:10.174452 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-83408bed-caee-4bc1-abca-f6d79941ae8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:10.175126 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-83408bed-caee-4bc1-abca-f6d79941ae8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:10.181638 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-83408bed-caee-4bc1-abca-f6d79941ae8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:10.182085 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-83408bed-caee-4bc1-abca-f6d79941ae8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:10.182919 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-83408bed-caee-4bc1-abca-f6d79941ae8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:10.183867 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-83408bed-caee-4bc1-abca-f6d79941ae8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:10.330692 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:10.331549 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:10.332350 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-83408bed-caee-4bc1-abca-f6d79941ae8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:10.338319 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:10.338918 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:10.339869 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:10.340377 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:10.341074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-83408bed-caee-4bc1-abca-f6d79941ae8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.170189 Jan 28 01:01:10.341796 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 255/475] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:10 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:10.376613 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:10.377054 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:10.377506 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'fault' on Instance uuid 213c2110-983e-47cc-b98c-6b8b91a5e7a3 {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:10.427601 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:10.441860 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a6d7bf14-b014-47c3-b1f3-54cd26bebd5e tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 200 len: 1312 microversion: 2.1 time: 0.115023 Jan 28 01:01:10.442486 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 221/476] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:10 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:10.604285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-502ab7b1-86ff-4fba-a4b3-95523f9fbf7d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:10.605687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-502ab7b1-86ff-4fba-a4b3-95523f9fbf7d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:10.612640 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-502ab7b1-86ff-4fba-a4b3-95523f9fbf7d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:10.613376 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-502ab7b1-86ff-4fba-a4b3-95523f9fbf7d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:10.614300 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-502ab7b1-86ff-4fba-a4b3-95523f9fbf7d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:10.614840 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-502ab7b1-86ff-4fba-a4b3-95523f9fbf7d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:10.680934 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-502ab7b1-86ff-4fba-a4b3-95523f9fbf7d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:10.689255 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-502ab7b1-86ff-4fba-a4b3-95523f9fbf7d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1254 microversion: 2.1 time: 0.089366 Jan 28 01:01:10.690102 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 256/477] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:10 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1254 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:11.360511 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-60929f34-7065-49a7-b194-3c313f62e5a1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:11.361158 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-60929f34-7065-49a7-b194-3c313f62e5a1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:11.373068 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-60929f34-7065-49a7-b194-3c313f62e5a1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.375038 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-60929f34-7065-49a7-b194-3c313f62e5a1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.376360 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-60929f34-7065-49a7-b194-3c313f62e5a1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.376769 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-60929f34-7065-49a7-b194-3c313f62e5a1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.459844 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6ab9b34e-933b-49d0-aa7b-f82ea6a3f1f3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:11.461703 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6ab9b34e-933b-49d0-aa7b-f82ea6a3f1f3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 213c2110-983e-47cc-b98c-6b8b91a5e7a3] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:11.469717 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6ab9b34e-933b-49d0-aa7b-f82ea6a3f1f3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.470166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6ab9b34e-933b-49d0-aa7b-f82ea6a3f1f3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.471010 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6ab9b34e-933b-49d0-aa7b-f82ea6a3f1f3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.471589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6ab9b34e-933b-49d0-aa7b-f82ea6a3f1f3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.494416 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-6ab9b34e-933b-49d0-aa7b-f82ea6a3f1f3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] HTTP exception thrown: Instance 213c2110-983e-47cc-b98c-6b8b91a5e7a3 could not be found. Jan 28 01:01:11.495249 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6ab9b34e-933b-49d0-aa7b-f82ea6a3f1f3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Returning 404 to user: Instance 213c2110-983e-47cc-b98c-6b8b91a5e7a3 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:01:11.496872 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6ab9b34e-933b-49d0-aa7b-f82ea6a3f1f3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3" status: 404 len: 111 microversion: 2.1 time: 0.040907 Jan 28 01:01:11.497667 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 257/478] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:11 2022] GET /compute/v2.1/servers/213c2110-983e-47cc-b98c-6b8b91a5e7a3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:01:11.505782 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3861fab7-4ea6-4722-a07f-bcb60d40a849 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:11.506291 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3861fab7-4ea6-4722-a07f-bcb60d40a849 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:11.522751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3861fab7-4ea6-4722-a07f-bcb60d40a849 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.523825 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3861fab7-4ea6-4722-a07f-bcb60d40a849 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.525219 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3861fab7-4ea6-4722-a07f-bcb60d40a849 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.525855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3861fab7-4ea6-4722-a07f-bcb60d40a849 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.561731 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3861fab7-4ea6-4722-a07f-bcb60d40a849 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Going to try to terminate instance {{(pid=116254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:01:11.673213 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-60929f34-7065-49a7-b194-3c313f62e5a1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:11.694809 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-60929f34-7065-49a7-b194-3c313f62e5a1 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.337418 Jan 28 01:01:11.695662 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 222/479] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:11 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:11.724039 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d23d9f43-de83-437f-ae50-3d0ffe577bab tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:11.725710 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d23d9f43-de83-437f-ae50-3d0ffe577bab tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:11.737618 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d23d9f43-de83-437f-ae50-3d0ffe577bab tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.738104 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d23d9f43-de83-437f-ae50-3d0ffe577bab tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.738983 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d23d9f43-de83-437f-ae50-3d0ffe577bab tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.739976 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d23d9f43-de83-437f-ae50-3d0ffe577bab tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.752540 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3861fab7-4ea6-4722-a07f-bcb60d40a849 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "DELETE /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 204 len: 0 microversion: 2.1 time: 0.249893 Jan 28 01:01:11.756426 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 258/480] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:01:11 2022] DELETE /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:01:11.763959 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b1ef6095-cd1d-466b-90b5-169797a01af1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:11.764954 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b1ef6095-cd1d-466b-90b5-169797a01af1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:11.778720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b1ef6095-cd1d-466b-90b5-169797a01af1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.779502 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b1ef6095-cd1d-466b-90b5-169797a01af1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.780807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b1ef6095-cd1d-466b-90b5-169797a01af1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:11.781393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b1ef6095-cd1d-466b-90b5-169797a01af1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.894828 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d23d9f43-de83-437f-ae50-3d0ffe577bab tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:11.938177 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d23d9f43-de83-437f-ae50-3d0ffe577bab tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1316 microversion: 2.1 time: 0.231454 Jan 28 01:01:11.964429 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 223/481] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:11 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:12.169485 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b1ef6095-cd1d-466b-90b5-169797a01af1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:12.188651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b1ef6095-cd1d-466b-90b5-169797a01af1 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.427782 Jan 28 01:01:12.191265 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 259/482] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:11 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:12.718171 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a80cf44d-9178-4f16-a6c7-6416fddcfb8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:12.719132 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a80cf44d-9178-4f16-a6c7-6416fddcfb8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:12.748966 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a80cf44d-9178-4f16-a6c7-6416fddcfb8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:12.759702 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a80cf44d-9178-4f16-a6c7-6416fddcfb8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:12.769206 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a80cf44d-9178-4f16-a6c7-6416fddcfb8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:12.770580 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a80cf44d-9178-4f16-a6c7-6416fddcfb8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:12.919832 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-56b24719-680b-4e4c-8c2c-9e926faa3993 req-00e40703-2fad-4807-b02d-bac88f8b13b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cc0552-4336-498f-b444-cc4e6338c62f", "name": "network-vif-plugged", "status": "completed", "tag": "2994a10b-5228-441d-8734-936c3bea9193"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:12.922113 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:12.922113 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:01:12.941851 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-56b24719-680b-4e4c-8c2c-9e926faa3993 req-00e40703-2fad-4807-b02d-bac88f8b13b0 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:12.942691 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-56b24719-680b-4e4c-8c2c-9e926faa3993 req-00e40703-2fad-4807-b02d-bac88f8b13b0 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:12.979668 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-56b24719-680b-4e4c-8c2c-9e926faa3993 req-00e40703-2fad-4807-b02d-bac88f8b13b0 service nova] Creating event network-vif-plugged:2994a10b-5228-441d-8734-936c3bea9193 for instance 30cc0552-4336-498f-b444-cc4e6338c62f on hv-cinder-81689 Jan 28 01:01:12.989933 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-56b24719-680b-4e4c-8c2c-9e926faa3993 req-00e40703-2fad-4807-b02d-bac88f8b13b0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073863 Jan 28 01:01:12.990546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 260/483] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:01:12.996157 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-dfc4ea7c-770b-41c1-b701-8a9b363c3c4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:12.996858 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-dfc4ea7c-770b-41c1-b701-8a9b363c3c4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:13.020218 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea7c-770b-41c1-b701-8a9b363c3c4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:13.020602 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea7c-770b-41c1-b701-8a9b363c3c4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:13.021506 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea7c-770b-41c1-b701-8a9b363c3c4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:13.022331 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dfc4ea7c-770b-41c1-b701-8a9b363c3c4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:13.174836 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:01:13.175251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: Fri Jan 28 01:01:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f (ip 10.222.0.78) !!! Jan 28 01:01:13.303348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-dfc4ea7c-770b-41c1-b701-8a9b363c3c4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:13.317165 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-dfc4ea7c-770b-41c1-b701-8a9b363c3c4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.324706 Jan 28 01:01:13.318022 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 261/484] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:12 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:13.325888 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-03057d44-e0e6-41c7-b4fd-e08a568f970c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:13.327521 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-03057d44-e0e6-41c7-b4fd-e08a568f970c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:13.338101 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-03057d44-e0e6-41c7-b4fd-e08a568f970c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:13.340361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-03057d44-e0e6-41c7-b4fd-e08a568f970c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:13.343024 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-03057d44-e0e6-41c7-b4fd-e08a568f970c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:13.346387 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-03057d44-e0e6-41c7-b4fd-e08a568f970c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:13.436611 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a80cf44d-9178-4f16-a6c7-6416fddcfb8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:13.453775 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a80cf44d-9178-4f16-a6c7-6416fddcfb8e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.743321 Jan 28 01:01:13.455548 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 224/485] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:12 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:13.571409 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-03057d44-e0e6-41c7-b4fd-e08a568f970c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:13.582176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-03057d44-e0e6-41c7-b4fd-e08a568f970c tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.262635 Jan 28 01:01:13.583323 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 262/486] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:13 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:14.343232 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-329e4060-fa9c-44a3-a589-a9e708ec3091 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:14.345498 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-329e4060-fa9c-44a3-a589-a9e708ec3091 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:14.378442 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-329e4060-fa9c-44a3-a589-a9e708ec3091 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:14.379705 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-329e4060-fa9c-44a3-a589-a9e708ec3091 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:14.380930 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-329e4060-fa9c-44a3-a589-a9e708ec3091 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:14.381908 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-329e4060-fa9c-44a3-a589-a9e708ec3091 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:14.443017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-41f460b8-75d3-4366-9b8e-64b7033da1b7 req-c91a1285-4f59-4dc1-8f77-c35e98db22a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07b7f77-0d8d-444b-9cad-fed068cdafec", "tag": "aaf8455f-185c-4280-8718-72bf446c9dc1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:14.454097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:14.454097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:01:14.478010 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-41f460b8-75d3-4366-9b8e-64b7033da1b7 req-c91a1285-4f59-4dc1-8f77-c35e98db22a7 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:14.480000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-41f460b8-75d3-4366-9b8e-64b7033da1b7 req-c91a1285-4f59-4dc1-8f77-c35e98db22a7 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:14.504784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-41f460b8-75d3-4366-9b8e-64b7033da1b7 req-c91a1285-4f59-4dc1-8f77-c35e98db22a7 service nova] Creating event network-changed:aaf8455f-185c-4280-8718-72bf446c9dc1 for instance a07b7f77-0d8d-444b-9cad-fed068cdafec on hv-cinder-81689 Jan 28 01:01:14.521873 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-41f460b8-75d3-4366-9b8e-64b7033da1b7 req-c91a1285-4f59-4dc1-8f77-c35e98db22a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092465 Jan 28 01:01:14.525398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 263/487] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:01:14.537195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-81f32a6a-4cab-4381-b523-4c58e6713993 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:14.540049 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-81f32a6a-4cab-4381-b523-4c58e6713993 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:14.560683 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-81f32a6a-4cab-4381-b523-4c58e6713993 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:14.562103 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-81f32a6a-4cab-4381-b523-4c58e6713993 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:14.563478 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-81f32a6a-4cab-4381-b523-4c58e6713993 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:14.564098 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-81f32a6a-4cab-4381-b523-4c58e6713993 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:14.737594 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-329e4060-fa9c-44a3-a589-a9e708ec3091 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:14.755244 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-329e4060-fa9c-44a3-a589-a9e708ec3091 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.420227 Jan 28 01:01:14.756000 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 225/488] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:14 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:14.770360 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0ed3abe1-3a57-49f1-9627-9a2ca476ccf3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:14.779617 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0ed3abe1-3a57-49f1-9627-9a2ca476ccf3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:14.792293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ed3abe1-3a57-49f1-9627-9a2ca476ccf3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:14.802171 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ed3abe1-3a57-49f1-9627-9a2ca476ccf3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:14.805489 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ed3abe1-3a57-49f1-9627-9a2ca476ccf3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:14.806198 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ed3abe1-3a57-49f1-9627-9a2ca476ccf3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:14.956007 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-81f32a6a-4cab-4381-b523-4c58e6713993 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:14.961661 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-81f32a6a-4cab-4381-b523-4c58e6713993 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.432453 Jan 28 01:01:14.962477 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 264/489] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:14 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:15.312323 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0ed3abe1-3a57-49f1-9627-9a2ca476ccf3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:15.328617 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0ed3abe1-3a57-49f1-9627-9a2ca476ccf3 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.564977 Jan 28 01:01:15.329390 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 226/490] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:14 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:15.774663 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-63c1f547-1b42-4f4b-a925-c045e999e786 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:15.775915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-63c1f547-1b42-4f4b-a925-c045e999e786 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:15.797144 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-63c1f547-1b42-4f4b-a925-c045e999e786 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:15.798061 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-63c1f547-1b42-4f4b-a925-c045e999e786 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:15.799188 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-63c1f547-1b42-4f4b-a925-c045e999e786 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:15.802678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-63c1f547-1b42-4f4b-a925-c045e999e786 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:15.986634 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c06438bd-5f32-4f94-bc60-fe75ea7ccf4d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:15.988316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c06438bd-5f32-4f94-bc60-fe75ea7ccf4d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:16.002155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c06438bd-5f32-4f94-bc60-fe75ea7ccf4d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:16.005357 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c06438bd-5f32-4f94-bc60-fe75ea7ccf4d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:16.006777 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c06438bd-5f32-4f94-bc60-fe75ea7ccf4d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:16.008400 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c06438bd-5f32-4f94-bc60-fe75ea7ccf4d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:16.041427 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-63c1f547-1b42-4f4b-a925-c045e999e786 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:16.056516 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-63c1f547-1b42-4f4b-a925-c045e999e786 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.285519 Jan 28 01:01:16.057705 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 265/491] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:15 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:16.357311 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d3cffd3c-a263-4188-8d61-58457f30c4eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:16.358120 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d3cffd3c-a263-4188-8d61-58457f30c4eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:16.375086 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d3cffd3c-a263-4188-8d61-58457f30c4eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:16.375515 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d3cffd3c-a263-4188-8d61-58457f30c4eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:16.376331 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d3cffd3c-a263-4188-8d61-58457f30c4eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:16.376762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d3cffd3c-a263-4188-8d61-58457f30c4eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:16.524471 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c06438bd-5f32-4f94-bc60-fe75ea7ccf4d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:16.541932 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c06438bd-5f32-4f94-bc60-fe75ea7ccf4d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1318 microversion: 2.1 time: 0.559299 Jan 28 01:01:16.560128 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 227/492] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:15 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:16.659529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d3cffd3c-a263-4188-8d61-58457f30c4eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:16.672197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d3cffd3c-a263-4188-8d61-58457f30c4eb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.325786 Jan 28 01:01:16.673780 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 266/493] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:16 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:17.084160 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-48185ac9-fc99-4d7e-a9d4-292ab38e87c2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:17.086132 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-48185ac9-fc99-4d7e-a9d4-292ab38e87c2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:17.113492 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-48185ac9-fc99-4d7e-a9d4-292ab38e87c2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:17.117725 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-48185ac9-fc99-4d7e-a9d4-292ab38e87c2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:17.120403 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-48185ac9-fc99-4d7e-a9d4-292ab38e87c2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:17.123687 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-48185ac9-fc99-4d7e-a9d4-292ab38e87c2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:17.448492 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-48185ac9-fc99-4d7e-a9d4-292ab38e87c2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:17.465426 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-48185ac9-fc99-4d7e-a9d4-292ab38e87c2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.388380 Jan 28 01:01:17.467039 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 228/494] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:17 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:17.565704 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-72ae506d-ac66-4318-b435-6cf1937fa37d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:17.566567 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-72ae506d-ac66-4318-b435-6cf1937fa37d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:17.594165 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-72ae506d-ac66-4318-b435-6cf1937fa37d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:17.595018 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-72ae506d-ac66-4318-b435-6cf1937fa37d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:17.599627 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-72ae506d-ac66-4318-b435-6cf1937fa37d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:17.600452 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-72ae506d-ac66-4318-b435-6cf1937fa37d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:17.728941 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3bd7165e-ab98-432a-a7c9-1f2ba79a0f2f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:17.729805 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3bd7165e-ab98-432a-a7c9-1f2ba79a0f2f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:17.738395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3bd7165e-ab98-432a-a7c9-1f2ba79a0f2f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:17.746779 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3bd7165e-ab98-432a-a7c9-1f2ba79a0f2f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:17.747969 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3bd7165e-ab98-432a-a7c9-1f2ba79a0f2f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:17.748534 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3bd7165e-ab98-432a-a7c9-1f2ba79a0f2f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:17.950063 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-72ae506d-ac66-4318-b435-6cf1937fa37d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:17.971578 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-72ae506d-ac66-4318-b435-6cf1937fa37d tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1506 microversion: 2.1 time: 0.414728 Jan 28 01:01:17.983941 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 267/495] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:17 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:18.003884 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a7321547-e2f7-4785-b901-7decc64d97fe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ca2a38f-e500-4a21-863a-ef08dd601250", "device": "/dev/sdb"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:18.006254 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a7321547-e2f7-4785-b901-7decc64d97fe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:18.026398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a7321547-e2f7-4785-b901-7decc64d97fe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:18.027178 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a7321547-e2f7-4785-b901-7decc64d97fe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:18.028397 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a7321547-e2f7-4785-b901-7decc64d97fe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:18.028870 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a7321547-e2f7-4785-b901-7decc64d97fe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:18.341599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3bd7165e-ab98-432a-a7c9-1f2ba79a0f2f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:18.366168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3bd7165e-ab98-432a-a7c9-1f2ba79a0f2f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.641261 Jan 28 01:01:18.381175 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 229/496] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:17 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:18.487661 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-753373a8-aa9e-462d-97b4-1105f0c1e5a6 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:18.489190 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-753373a8-aa9e-462d-97b4-1105f0c1e5a6 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:18.501551 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-753373a8-aa9e-462d-97b4-1105f0c1e5a6 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:18.502548 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-753373a8-aa9e-462d-97b4-1105f0c1e5a6 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:18.503690 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-753373a8-aa9e-462d-97b4-1105f0c1e5a6 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:18.505762 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-753373a8-aa9e-462d-97b4-1105f0c1e5a6 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:18.539423 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a7321547-e2f7-4785-b901-7decc64d97fe tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "POST /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546610 Jan 28 01:01:18.548694 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 268/497] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:01:17 2022] POST /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:19.010077 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-753373a8-aa9e-462d-97b4-1105f0c1e5a6 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:19.030758 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-753373a8-aa9e-462d-97b4-1105f0c1e5a6 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.547014 Jan 28 01:01:19.034160 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 230/498] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:18 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:19.394330 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2720928e-7665-4d5e-ac4f-6a3ab3b5a5d9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:19.397708 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2720928e-7665-4d5e-ac4f-6a3ab3b5a5d9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:19.407688 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2720928e-7665-4d5e-ac4f-6a3ab3b5a5d9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:19.409728 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2720928e-7665-4d5e-ac4f-6a3ab3b5a5d9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:19.409728 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2720928e-7665-4d5e-ac4f-6a3ab3b5a5d9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:19.409728 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2720928e-7665-4d5e-ac4f-6a3ab3b5a5d9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:19.711088 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2720928e-7665-4d5e-ac4f-6a3ab3b5a5d9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:19.731397 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2720928e-7665-4d5e-ac4f-6a3ab3b5a5d9 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.335645 Jan 28 01:01:19.742878 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 269/499] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:19 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:20.057916 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2d94d3e5-e6f7-4181-9978-99e8b8d13913 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:20.059132 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2d94d3e5-e6f7-4181-9978-99e8b8d13913 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:20.077256 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2d94d3e5-e6f7-4181-9978-99e8b8d13913 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:20.078147 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2d94d3e5-e6f7-4181-9978-99e8b8d13913 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:20.079605 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2d94d3e5-e6f7-4181-9978-99e8b8d13913 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:20.080395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2d94d3e5-e6f7-4181-9978-99e8b8d13913 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:20.361052 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2d94d3e5-e6f7-4181-9978-99e8b8d13913 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:20.377975 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2d94d3e5-e6f7-4181-9978-99e8b8d13913 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.323922 Jan 28 01:01:20.379463 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 231/500] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:20 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:20.750761 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7921608e-9805-41e5-832f-2b7e53f4b278 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:20.752376 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7921608e-9805-41e5-832f-2b7e53f4b278 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:20.760831 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7921608e-9805-41e5-832f-2b7e53f4b278 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:20.761766 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7921608e-9805-41e5-832f-2b7e53f4b278 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:20.762969 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7921608e-9805-41e5-832f-2b7e53f4b278 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:20.763902 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7921608e-9805-41e5-832f-2b7e53f4b278 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:21.105684 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7921608e-9805-41e5-832f-2b7e53f4b278 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:21.121242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7921608e-9805-41e5-832f-2b7e53f4b278 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.374004 Jan 28 01:01:21.136365 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 270/501] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:20 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:21.400408 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e20ae921-0287-42df-9af3-98a11dbab1b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:21.401343 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e20ae921-0287-42df-9af3-98a11dbab1b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:21.425955 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e20ae921-0287-42df-9af3-98a11dbab1b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:21.426404 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e20ae921-0287-42df-9af3-98a11dbab1b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:21.427450 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e20ae921-0287-42df-9af3-98a11dbab1b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:21.428054 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e20ae921-0287-42df-9af3-98a11dbab1b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:21.669457 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e20ae921-0287-42df-9af3-98a11dbab1b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:21.677827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e20ae921-0287-42df-9af3-98a11dbab1b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.281539 Jan 28 01:01:21.682075 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 232/502] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:21 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:22.150853 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c7b7cd2f-ed7f-43a4-944e-f44ad618a434 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:22.152860 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c7b7cd2f-ed7f-43a4-944e-f44ad618a434 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:22.167784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7b7cd2f-ed7f-43a4-944e-f44ad618a434 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:22.168687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7b7cd2f-ed7f-43a4-944e-f44ad618a434 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:22.169831 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7b7cd2f-ed7f-43a4-944e-f44ad618a434 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:22.170538 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7b7cd2f-ed7f-43a4-944e-f44ad618a434 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:22.425751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c7b7cd2f-ed7f-43a4-944e-f44ad618a434 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:22.446114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c7b7cd2f-ed7f-43a4-944e-f44ad618a434 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.298323 Jan 28 01:01:22.459367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 271/503] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:22 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:22.700885 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9c0d6d0a-a8d0-4d1e-b22c-6a0094786124 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:22.701490 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9c0d6d0a-a8d0-4d1e-b22c-6a0094786124 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:22.718946 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d0a-a8d0-4d1e-b22c-6a0094786124 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:22.719729 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d0a-a8d0-4d1e-b22c-6a0094786124 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:22.720763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d0a-a8d0-4d1e-b22c-6a0094786124 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:22.721388 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c0d6d0a-a8d0-4d1e-b22c-6a0094786124 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:23.102948 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-9c0d6d0a-a8d0-4d1e-b22c-6a0094786124 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:23.119859 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9c0d6d0a-a8d0-4d1e-b22c-6a0094786124 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.422851 Jan 28 01:01:23.127091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 233/504] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:22 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:23.477126 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9c57036f-c51e-4e86-8d3a-9fc373978eaa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:23.478835 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9c57036f-c51e-4e86-8d3a-9fc373978eaa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:23.497925 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9c57036f-c51e-4e86-8d3a-9fc373978eaa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:23.498739 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9c57036f-c51e-4e86-8d3a-9fc373978eaa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:23.499780 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9c57036f-c51e-4e86-8d3a-9fc373978eaa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:23.500383 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9c57036f-c51e-4e86-8d3a-9fc373978eaa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:23.755703 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9c57036f-c51e-4e86-8d3a-9fc373978eaa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:23.764820 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9c57036f-c51e-4e86-8d3a-9fc373978eaa tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.294127 Jan 28 01:01:23.777748 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 272/505] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:23 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:24.154288 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1fd02561-a59a-452f-ac84-15efd79f79e2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:24.155238 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1fd02561-a59a-452f-ac84-15efd79f79e2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:24.166781 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fd02561-a59a-452f-ac84-15efd79f79e2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:24.167299 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fd02561-a59a-452f-ac84-15efd79f79e2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:24.168119 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fd02561-a59a-452f-ac84-15efd79f79e2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:24.169105 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fd02561-a59a-452f-ac84-15efd79f79e2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:24.391803 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1fd02561-a59a-452f-ac84-15efd79f79e2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:24.400467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1fd02561-a59a-452f-ac84-15efd79f79e2 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.252671 Jan 28 01:01:24.401237 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 234/506] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:24 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:24.784067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-090d2a5e-69de-4ab4-acde-c451c9d9e30f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:24.785449 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-090d2a5e-69de-4ab4-acde-c451c9d9e30f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:24.792313 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-090d2a5e-69de-4ab4-acde-c451c9d9e30f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:24.792766 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-090d2a5e-69de-4ab4-acde-c451c9d9e30f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:24.793556 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-090d2a5e-69de-4ab4-acde-c451c9d9e30f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:24.793995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-090d2a5e-69de-4ab4-acde-c451c9d9e30f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:24.971529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-090d2a5e-69de-4ab4-acde-c451c9d9e30f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:24.982172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-090d2a5e-69de-4ab4-acde-c451c9d9e30f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.201699 Jan 28 01:01:24.983012 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 273/507] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:24 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:25.421640 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0f0a77f6-6649-40ad-81a2-364b9e24ad13 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:25.423055 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0f0a77f6-6649-40ad-81a2-364b9e24ad13 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:25.433702 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f0a77f6-6649-40ad-81a2-364b9e24ad13 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:25.434478 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f0a77f6-6649-40ad-81a2-364b9e24ad13 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:25.435957 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f0a77f6-6649-40ad-81a2-364b9e24ad13 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:25.436717 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f0a77f6-6649-40ad-81a2-364b9e24ad13 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:25.644747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0f0a77f6-6649-40ad-81a2-364b9e24ad13 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:25.653197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0f0a77f6-6649-40ad-81a2-364b9e24ad13 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.236768 Jan 28 01:01:25.653782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 235/508] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:25 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:26.006864 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-07faf690-cf4c-4bbb-8a6c-8572306a60cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:26.009008 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-07faf690-cf4c-4bbb-8a6c-8572306a60cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:26.022219 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-07faf690-cf4c-4bbb-8a6c-8572306a60cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:26.023155 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-07faf690-cf4c-4bbb-8a6c-8572306a60cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:26.024770 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-07faf690-cf4c-4bbb-8a6c-8572306a60cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:26.025895 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-07faf690-cf4c-4bbb-8a6c-8572306a60cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:26.271544 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-07faf690-cf4c-4bbb-8a6c-8572306a60cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:26.287050 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-07faf690-cf4c-4bbb-8a6c-8572306a60cb tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.286648 Jan 28 01:01:26.288688 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 274/509] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:25 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:26.676096 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-db1e9a22-cfba-4fc4-b312-c318b4f227a1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:26.677592 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-db1e9a22-cfba-4fc4-b312-c318b4f227a1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:26.688192 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-db1e9a22-cfba-4fc4-b312-c318b4f227a1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:26.689511 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-db1e9a22-cfba-4fc4-b312-c318b4f227a1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:26.691098 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-db1e9a22-cfba-4fc4-b312-c318b4f227a1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:26.691808 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-db1e9a22-cfba-4fc4-b312-c318b4f227a1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:26.880259 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-db1e9a22-cfba-4fc4-b312-c318b4f227a1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:26.894169 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-db1e9a22-cfba-4fc4-b312-c318b4f227a1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.222025 Jan 28 01:01:26.907399 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 236/510] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:26 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:27.320196 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-739c651c-3136-4b1e-b569-27ff98bb9b44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:27.320928 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-739c651c-3136-4b1e-b569-27ff98bb9b44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:27.329077 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-739c651c-3136-4b1e-b569-27ff98bb9b44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:27.329670 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-739c651c-3136-4b1e-b569-27ff98bb9b44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:27.330572 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-739c651c-3136-4b1e-b569-27ff98bb9b44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:27.331938 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-739c651c-3136-4b1e-b569-27ff98bb9b44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:27.532951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-739c651c-3136-4b1e-b569-27ff98bb9b44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:27.546241 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-739c651c-3136-4b1e-b569-27ff98bb9b44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1523 microversion: 2.1 time: 0.232898 Jan 28 01:01:27.548889 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 275/511] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:27 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:27.764613 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-667d208f-5813-4527-879d-25ed0f207e32 req-6510dba1-ada7-42a7-aed3-840fde88e2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31", "name": "network-vif-deleted", "tag": "9c62ad7c-9f29-464d-b6ad-f74102e3735b"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:27.770591 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:27.770591 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:01:27.789018 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-667d208f-5813-4527-879d-25ed0f207e32 req-6510dba1-ada7-42a7-aed3-840fde88e2a6 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:27.790299 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-667d208f-5813-4527-879d-25ed0f207e32 req-6510dba1-ada7-42a7-aed3-840fde88e2a6 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:27.846973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-667d208f-5813-4527-879d-25ed0f207e32 req-6510dba1-ada7-42a7-aed3-840fde88e2a6 service nova] Creating event network-vif-deleted:9c62ad7c-9f29-464d-b6ad-f74102e3735b for instance 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 on hv-cinder-81689 Jan 28 01:01:27.870510 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-667d208f-5813-4527-879d-25ed0f207e32 req-6510dba1-ada7-42a7-aed3-840fde88e2a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111753 Jan 28 01:01:27.875980 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 237/512] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:27.923932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3a9af5c3-e5d1-4a2a-83e7-10191bff0fd9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:27.925078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3a9af5c3-e5d1-4a2a-83e7-10191bff0fd9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:27.947024 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a9af5c3-e5d1-4a2a-83e7-10191bff0fd9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:27.952405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a9af5c3-e5d1-4a2a-83e7-10191bff0fd9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:27.955311 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a9af5c3-e5d1-4a2a-83e7-10191bff0fd9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:27.965395 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a9af5c3-e5d1-4a2a-83e7-10191bff0fd9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:28.145560 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3a9af5c3-e5d1-4a2a-83e7-10191bff0fd9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:28.155864 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3a9af5c3-e5d1-4a2a-83e7-10191bff0fd9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.238679 Jan 28 01:01:28.157762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 276/513] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:27 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:28.570955 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:28.571738 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:28.581459 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:28.582432 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:28.583561 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:28.584248 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:28.640019 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:28.640568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:28.641361 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'fault' on Instance uuid 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:28.710293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:28.718810 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-28f03881-fd1a-4985-ad80-5d39b2ad8ca0 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1312 microversion: 2.1 time: 0.156248 Jan 28 01:01:28.719731 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 238/514] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:28 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:29.176217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4010c020-f4b5-47ee-8284-b58d9e1af9a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:29.178361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4010c020-f4b5-47ee-8284-b58d9e1af9a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:29.188822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4010c020-f4b5-47ee-8284-b58d9e1af9a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:29.190007 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4010c020-f4b5-47ee-8284-b58d9e1af9a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:29.191706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4010c020-f4b5-47ee-8284-b58d9e1af9a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:29.192452 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4010c020-f4b5-47ee-8284-b58d9e1af9a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:29.387039 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4010c020-f4b5-47ee-8284-b58d9e1af9a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:29.402928 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4010c020-f4b5-47ee-8284-b58d9e1af9a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.228182 Jan 28 01:01:29.404675 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 277/515] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:29 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:29.737768 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:29.738416 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:29.745990 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:29.746449 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:29.748411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:29.749004 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:29.790196 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:29.790940 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:29.791577 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'fault' on Instance uuid 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:29.834835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:29.848980 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-83d16808-c982-4b54-aec5-9d3c0f7d0e44 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1312 microversion: 2.1 time: 0.115037 Jan 28 01:01:29.849782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 239/516] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:29 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:30.435316 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d1526463-215a-4c4f-a05b-c2d5372dfcb5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:30.439764 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d1526463-215a-4c4f-a05b-c2d5372dfcb5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:30.460890 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1526463-215a-4c4f-a05b-c2d5372dfcb5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:30.461451 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1526463-215a-4c4f-a05b-c2d5372dfcb5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:30.462416 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1526463-215a-4c4f-a05b-c2d5372dfcb5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:30.463003 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1526463-215a-4c4f-a05b-c2d5372dfcb5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:30.679843 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d1526463-215a-4c4f-a05b-c2d5372dfcb5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:30.691617 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d1526463-215a-4c4f-a05b-c2d5372dfcb5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.263627 Jan 28 01:01:30.704824 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 278/517] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:30 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:30.868017 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:30.869358 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:30.876267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:30.877070 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:30.878119 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:30.878670 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:30.912060 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:30.912836 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:30.913484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lazy-loading 'fault' on Instance uuid 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:30.960729 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6a0f3a718b4996923e7adc8df7a658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3356a09ca24dd78dc3ad054e04830c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:30.971674 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-62739b4d-1bdc-42b6-8179-a86260b5a210 tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 200 len: 1312 microversion: 2.1 time: 0.108455 Jan 28 01:01:30.981606 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 240/518] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:30 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:31.714754 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3463bdeb-7721-43a7-a49d-16e29197bc4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:31.715419 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3463bdeb-7721-43a7-a49d-16e29197bc4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:31.721944 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3463bdeb-7721-43a7-a49d-16e29197bc4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:31.722386 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3463bdeb-7721-43a7-a49d-16e29197bc4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:31.723194 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3463bdeb-7721-43a7-a49d-16e29197bc4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:31.723644 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3463bdeb-7721-43a7-a49d-16e29197bc4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:31.868800 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3463bdeb-7721-43a7-a49d-16e29197bc4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:31.877320 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3463bdeb-7721-43a7-a49d-16e29197bc4b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.166290 Jan 28 01:01:31.877913 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 279/519] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:31 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:31.989212 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a6e0f254-0bd6-4283-828a-38cd4cfbf66f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:31.990030 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a6e0f254-0bd6-4283-828a-38cd4cfbf66f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] [instance: 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:31.996807 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6e0f254-0bd6-4283-828a-38cd4cfbf66f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:31.997269 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6e0f254-0bd6-4283-828a-38cd4cfbf66f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:31.998070 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6e0f254-0bd6-4283-828a-38cd4cfbf66f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:31.998508 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a6e0f254-0bd6-4283-828a-38cd4cfbf66f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:32.012966 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-a6e0f254-0bd6-4283-828a-38cd4cfbf66f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] HTTP exception thrown: Instance 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 could not be found. Jan 28 01:01:32.013567 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a6e0f254-0bd6-4283-828a-38cd4cfbf66f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] Returning 404 to user: Instance 82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:01:32.014413 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a6e0f254-0bd6-4283-828a-38cd4cfbf66f tempest-ServerRescueNegativeTestJSON-1133070112 tempest-ServerRescueNegativeTestJSON-1133070112-project] 10.222.0.78 "GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31" status: 404 len: 111 microversion: 2.1 time: 0.028967 Jan 28 01:01:32.014994 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 241/520] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:31 2022] GET /compute/v2.1/servers/82e3b6f7-c2b3-4035-aca1-fcad2d5f0c31 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:01:32.894758 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1f1917f4-2df8-449e-9407-388c0be33941 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:32.895435 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1f1917f4-2df8-449e-9407-388c0be33941 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:32.903072 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f1917f4-2df8-449e-9407-388c0be33941 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:32.903608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f1917f4-2df8-449e-9407-388c0be33941 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:32.904599 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f1917f4-2df8-449e-9407-388c0be33941 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:32.905063 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f1917f4-2df8-449e-9407-388c0be33941 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:33.338399 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1f1917f4-2df8-449e-9407-388c0be33941 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:33.346252 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1f1917f4-2df8-449e-9407-388c0be33941 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.455038 Jan 28 01:01:33.347340 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 280/521] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:32 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:34.363980 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f409bc06-1523-4f60-903f-dbbdfe5781c9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:34.365082 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f409bc06-1523-4f60-903f-dbbdfe5781c9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:34.375807 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f409bc06-1523-4f60-903f-dbbdfe5781c9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:34.376266 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f409bc06-1523-4f60-903f-dbbdfe5781c9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:34.377506 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f409bc06-1523-4f60-903f-dbbdfe5781c9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:34.378343 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f409bc06-1523-4f60-903f-dbbdfe5781c9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:34.522550 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-cf3e1b76-d74f-4fb0-af8c-335d49246f66 req-91d31d51-f687-4a7a-9b9b-0e07ff577728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07b7f77-0d8d-444b-9cad-fed068cdafec", "name": "network-vif-plugged", "status": "completed", "tag": "aaf8455f-185c-4280-8718-72bf446c9dc1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:34.526987 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:34.526987 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:01:34.540511 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-cf3e1b76-d74f-4fb0-af8c-335d49246f66 req-91d31d51-f687-4a7a-9b9b-0e07ff577728 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:34.541771 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-cf3e1b76-d74f-4fb0-af8c-335d49246f66 req-91d31d51-f687-4a7a-9b9b-0e07ff577728 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:34.561180 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-cf3e1b76-d74f-4fb0-af8c-335d49246f66 req-91d31d51-f687-4a7a-9b9b-0e07ff577728 service nova] Creating event network-vif-plugged:aaf8455f-185c-4280-8718-72bf446c9dc1 for instance a07b7f77-0d8d-444b-9cad-fed068cdafec on hv-cinder-81689 Jan 28 01:01:34.568216 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-cf3e1b76-d74f-4fb0-af8c-335d49246f66 req-91d31d51-f687-4a7a-9b9b-0e07ff577728 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054199 Jan 28 01:01:34.569412 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 281/522] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:34.736058 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f409bc06-1523-4f60-903f-dbbdfe5781c9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:34.743971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f409bc06-1523-4f60-903f-dbbdfe5781c9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.384354 Jan 28 01:01:34.744557 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 242/523] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:34 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:35.765413 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ed9ff342-0f77-4372-8be9-5ff40ac82b8d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:35.766342 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ed9ff342-0f77-4372-8be9-5ff40ac82b8d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:35.775260 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ed9ff342-0f77-4372-8be9-5ff40ac82b8d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:35.775403 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ed9ff342-0f77-4372-8be9-5ff40ac82b8d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:35.776179 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ed9ff342-0f77-4372-8be9-5ff40ac82b8d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:35.776628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ed9ff342-0f77-4372-8be9-5ff40ac82b8d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:35.911729 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ed9ff342-0f77-4372-8be9-5ff40ac82b8d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:35.919086 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ed9ff342-0f77-4372-8be9-5ff40ac82b8d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.159020 Jan 28 01:01:35.919680 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 282/524] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:35 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:36.942837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ea381b35-7d0b-437a-a058-6c7adda73caf tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:36.944558 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ea381b35-7d0b-437a-a058-6c7adda73caf tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:36.952615 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ea381b35-7d0b-437a-a058-6c7adda73caf tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:36.953074 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ea381b35-7d0b-437a-a058-6c7adda73caf tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:36.954257 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ea381b35-7d0b-437a-a058-6c7adda73caf tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:36.954906 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ea381b35-7d0b-437a-a058-6c7adda73caf tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:37.126718 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ea381b35-7d0b-437a-a058-6c7adda73caf tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:37.136818 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ea381b35-7d0b-437a-a058-6c7adda73caf tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1358 microversion: 2.1 time: 0.203639 Jan 28 01:01:37.137401 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 243/525] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:36 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:38.160297 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bb62b856-95f3-42c6-8a9f-4db67b568ccd tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:38.163178 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-bb62b856-95f3-42c6-8a9f-4db67b568ccd tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:38.172625 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bb62b856-95f3-42c6-8a9f-4db67b568ccd tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.173182 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bb62b856-95f3-42c6-8a9f-4db67b568ccd tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.173987 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bb62b856-95f3-42c6-8a9f-4db67b568ccd tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.174613 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bb62b856-95f3-42c6-8a9f-4db67b568ccd tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.297162 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1572099597", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "networks": [{"uuid": "8d64b8b0-7739-4455-9d0c-091754eae844"}]}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:38.345891 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-bb62b856-95f3-42c6-8a9f-4db67b568ccd tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:38.353865 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bb62b856-95f3-42c6-8a9f-4db67b568ccd tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1548 microversion: 2.1 time: 0.202929 Jan 28 01:01:38.356202 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] validate_networks() for [('8d64b8b0-7739-4455-9d0c-091754eae844', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:01:38.365912 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 244/526] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:38 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1548 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:38.371889 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-223962e3-a87e-412a-a359-38f1d1277546 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:38.372599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-223962e3-a87e-412a-a359-38f1d1277546 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:38.378988 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223962e3-a87e-412a-a359-38f1d1277546 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.379527 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223962e3-a87e-412a-a359-38f1d1277546 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.381621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223962e3-a87e-412a-a359-38f1d1277546 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.381621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223962e3-a87e-412a-a359-38f1d1277546 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.560914 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-223962e3-a87e-412a-a359-38f1d1277546 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:38.570760 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-223962e3-a87e-412a-a359-38f1d1277546 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1548 microversion: 2.1 time: 0.203176 Jan 28 01:01:38.571397 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 245/527] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:38 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1548 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:38.599508 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d75d2008-2f8a-42fc-aaad-5896afdf2467 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:38.605782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:38.605782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:01:38.607703 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d75d2008-2f8a-42fc-aaad-5896afdf2467 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:38.608997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d75d2008-2f8a-42fc-aaad-5896afdf2467 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Searching by: {'deleted': False, 'project_id': 'e43c3f3031ee40508283209d12740ec8'} {{(pid=116253) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 28 01:01:38.620930 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d75d2008-2f8a-42fc-aaad-5896afdf2467 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.621675 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d75d2008-2f8a-42fc-aaad-5896afdf2467 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.623395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d75d2008-2f8a-42fc-aaad-5896afdf2467 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.624134 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d75d2008-2f8a-42fc-aaad-5896afdf2467 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.748005 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.multi_cell_list [None req-d75d2008-2f8a-42fc-aaad-5896afdf2467 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116253) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 28 01:01:38.813961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:01:38.814649 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:01:38.815674 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:01:38.823631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:01:38.823631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:01:38.832229 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.832681 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.833499 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.833940 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.850860 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Getting quotas for project 433c6f07b086479f94f16f5314942da7. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:01:38.855560 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Getting quotas for user 957a7c1ed6e045fdb3252969ea163b24 and project 433c6f07b086479f94f16f5314942da7. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:01:38.867102 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:01:38.869439 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:01:38.900375 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d75d2008-2f8a-42fc-aaad-5896afdf2467 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.307798 Jan 28 01:01:38.900976 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 246/528] 10.222.0.78 () {58 vars in 1124 bytes} [Fri Jan 28 01:01:38 2022] GET /compute/v2.1/servers => generated 343 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:38.911020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8dc64bbf-4892-4b37-8f90-800dcfe257eb tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:38.911640 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8dc64bbf-4892-4b37-8f90-800dcfe257eb tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:38.913794 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fe276a43-2d0e-49b2-b6de-f0a3f7452697 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895790 Jan 28 01:01:38.914661 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 283/529] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:01:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:01:38.918800 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8dc64bbf-4892-4b37-8f90-800dcfe257eb tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.919264 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8dc64bbf-4892-4b37-8f90-800dcfe257eb tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.920163 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8dc64bbf-4892-4b37-8f90-800dcfe257eb tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.920614 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8dc64bbf-4892-4b37-8f90-800dcfe257eb tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.924635 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-88572653-3505-493a-94de-bbc1d1b3fc9f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:38.925255 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-88572653-3505-493a-94de-bbc1d1b3fc9f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:38.984971 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-88572653-3505-493a-94de-bbc1d1b3fc9f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:38.993591 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-88572653-3505-493a-94de-bbc1d1b3fc9f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1218 microversion: 2.1 time: 0.072495 Jan 28 01:01:38.994176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 284/530] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:38 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:39.070835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8dc64bbf-4892-4b37-8f90-800dcfe257eb tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:39.079334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8dc64bbf-4892-4b37-8f90-800dcfe257eb tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1548 microversion: 2.1 time: 0.171718 Jan 28 01:01:39.079914 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 247/531] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:38 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:39.847671 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2685d4e7-044e-495f-bdcd-e12eccb5ecbc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:39.848491 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2685d4e7-044e-495f-bdcd-e12eccb5ecbc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:39.855205 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2685d4e7-044e-495f-bdcd-e12eccb5ecbc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:39.855656 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2685d4e7-044e-495f-bdcd-e12eccb5ecbc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:39.856442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2685d4e7-044e-495f-bdcd-e12eccb5ecbc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:39.856879 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2685d4e7-044e-495f-bdcd-e12eccb5ecbc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:39.948915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-2685d4e7-044e-495f-bdcd-e12eccb5ecbc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lazy-loading 'services' on Instance uuid 30cc0552-4336-498f-b444-cc4e6338c62f {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:40.011811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b4976c47-5f78-4517-b3cd-8e2bac100633 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:40.012613 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b4976c47-5f78-4517-b3cd-8e2bac100633 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:40.025432 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b4976c47-5f78-4517-b3cd-8e2bac100633 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:40.025891 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b4976c47-5f78-4517-b3cd-8e2bac100633 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:40.027283 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b4976c47-5f78-4517-b3cd-8e2bac100633 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:40.027727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b4976c47-5f78-4517-b3cd-8e2bac100633 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:40.044195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2685d4e7-044e-495f-bdcd-e12eccb5ecbc tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f/os-volume_attachments/7ca2a38f-e500-4a21-863a-ef08dd601250" status: 202 len: 0 microversion: 2.1 time: 0.199977 Jan 28 01:01:40.045172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 285/532] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:01:39 2022] DELETE /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f/os-volume_attachments/7ca2a38f-e500-4a21-863a-ef08dd601250 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:01:40.117647 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b4976c47-5f78-4517-b3cd-8e2bac100633 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:40.126084 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b4976c47-5f78-4517-b3cd-8e2bac100633 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1270 microversion: 2.1 time: 0.118570 Jan 28 01:01:40.126798 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 248/533] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:40 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:40.709961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-608d45a2-5345-4462-b67c-cc0cc79d07a4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68014e04-f559-4b04-ab22-9a0b5cdbd209"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:40.717622 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-608d45a2-5345-4462-b67c-cc0cc79d07a4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:40.718519 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-608d45a2-5345-4462-b67c-cc0cc79d07a4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:40.718519 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-608d45a2-5345-4462-b67c-cc0cc79d07a4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:40.719275 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-608d45a2-5345-4462-b67c-cc0cc79d07a4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:40.719722 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-608d45a2-5345-4462-b67c-cc0cc79d07a4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.028389 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-608d45a2-5345-4462-b67c-cc0cc79d07a4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "POST /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328498 Jan 28 01:01:41.029163 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 286/534] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:01:40 2022] POST /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:41.143350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0615d6ca-e9a9-4c13-84e0-78e7afd8fb50 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:41.144749 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0615d6ca-e9a9-4c13-84e0-78e7afd8fb50 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:41.154127 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0615d6ca-e9a9-4c13-84e0-78e7afd8fb50 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.154835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0615d6ca-e9a9-4c13-84e0-78e7afd8fb50 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.155833 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0615d6ca-e9a9-4c13-84e0-78e7afd8fb50 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.156588 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0615d6ca-e9a9-4c13-84e0-78e7afd8fb50 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.206745 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b41ae731-e3de-4122-9448-860079f731dd tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:41.207478 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b41ae731-e3de-4122-9448-860079f731dd tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:41.215017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b41ae731-e3de-4122-9448-860079f731dd tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.215676 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b41ae731-e3de-4122-9448-860079f731dd tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.216599 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b41ae731-e3de-4122-9448-860079f731dd tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.217252 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b41ae731-e3de-4122-9448-860079f731dd tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.249977 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b41ae731-e3de-4122-9448-860079f731dd tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Going to try to terminate instance {{(pid=116254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:01:41.355983 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b41ae731-e3de-4122-9448-860079f731dd tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "DELETE /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 204 len: 0 microversion: 2.1 time: 0.152372 Jan 28 01:01:41.357000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 287/535] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:01:41 2022] DELETE /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 01:01:41.368524 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-be85bbd9-4462-4197-9784-ddf81c2c5356 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:41.369237 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-be85bbd9-4462-4197-9784-ddf81c2c5356 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:41.376769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-be85bbd9-4462-4197-9784-ddf81c2c5356 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.377223 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-be85bbd9-4462-4197-9784-ddf81c2c5356 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.378199 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-be85bbd9-4462-4197-9784-ddf81c2c5356 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.378833 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-be85bbd9-4462-4197-9784-ddf81c2c5356 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.441546 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0615d6ca-e9a9-4c13-84e0-78e7afd8fb50 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:41.454282 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0615d6ca-e9a9-4c13-84e0-78e7afd8fb50 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.314720 Jan 28 01:01:41.455307 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 249/536] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:41 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:41.537861 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-be85bbd9-4462-4197-9784-ddf81c2c5356 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:41.547637 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-be85bbd9-4462-4197-9784-ddf81c2c5356 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1512 microversion: 2.1 time: 0.183974 Jan 28 01:01:41.548223 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 288/537] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:41 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:41.811111 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-b7d5aeac-d1c9-4ee4-98b4-6f9fa00628fc req-0cedee22-f12d-4058-9e39-acea2d652b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19505ea2-2d12-47cf-9a5f-d5185a64ffc4", "tag": "7ee19dba-7e3e-494c-881c-7d8ecc7fabdc"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:41.812600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:41.812600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:01:41.821155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-b7d5aeac-d1c9-4ee4-98b4-6f9fa00628fc req-0cedee22-f12d-4058-9e39-acea2d652b71 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.821888 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-b7d5aeac-d1c9-4ee4-98b4-6f9fa00628fc req-0cedee22-f12d-4058-9e39-acea2d652b71 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.836350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-b7d5aeac-d1c9-4ee4-98b4-6f9fa00628fc req-0cedee22-f12d-4058-9e39-acea2d652b71 service nova] Creating event network-changed:7ee19dba-7e3e-494c-881c-7d8ecc7fabdc for instance 19505ea2-2d12-47cf-9a5f-d5185a64ffc4 on hv-cinder-81689 Jan 28 01:01:41.841316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-b7d5aeac-d1c9-4ee4-98b4-6f9fa00628fc req-0cedee22-f12d-4058-9e39-acea2d652b71 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035063 Jan 28 01:01:41.841918 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 250/538] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:42.471105 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2c380fb9-6189-41c4-9a41-38d8fd76cac3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:42.471738 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2c380fb9-6189-41c4-9a41-38d8fd76cac3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:42.478480 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2c380fb9-6189-41c4-9a41-38d8fd76cac3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:42.478961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2c380fb9-6189-41c4-9a41-38d8fd76cac3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:42.479767 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2c380fb9-6189-41c4-9a41-38d8fd76cac3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:42.480204 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2c380fb9-6189-41c4-9a41-38d8fd76cac3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:42.567764 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0a6e78ce-76ac-4534-bdae-33ded04ccdee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:42.568586 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0a6e78ce-76ac-4534-bdae-33ded04ccdee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:42.578259 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a6e78ce-76ac-4534-bdae-33ded04ccdee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:42.578259 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a6e78ce-76ac-4534-bdae-33ded04ccdee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:42.579507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a6e78ce-76ac-4534-bdae-33ded04ccdee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:42.579747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a6e78ce-76ac-4534-bdae-33ded04ccdee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:42.653142 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2c380fb9-6189-41c4-9a41-38d8fd76cac3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:42.669395 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2c380fb9-6189-41c4-9a41-38d8fd76cac3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.201789 Jan 28 01:01:42.670224 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 289/539] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:42 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:42.841141 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0a6e78ce-76ac-4534-bdae-33ded04ccdee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:42.849285 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0a6e78ce-76ac-4534-bdae-33ded04ccdee tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1512 microversion: 2.1 time: 0.287220 Jan 28 01:01:42.849860 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 251/540] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:42 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:43.685987 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d68bd484-7491-4eb1-b59e-efbd9dc923ce tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:43.686602 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d68bd484-7491-4eb1-b59e-efbd9dc923ce tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:43.693083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d68bd484-7491-4eb1-b59e-efbd9dc923ce tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:43.693535 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d68bd484-7491-4eb1-b59e-efbd9dc923ce tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:43.694320 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d68bd484-7491-4eb1-b59e-efbd9dc923ce tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:43.694756 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d68bd484-7491-4eb1-b59e-efbd9dc923ce tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:43.851727 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d68bd484-7491-4eb1-b59e-efbd9dc923ce tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:43.860592 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d68bd484-7491-4eb1-b59e-efbd9dc923ce tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.178057 Jan 28 01:01:43.861435 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 290/541] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:43 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:43.876152 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a8a4ef51-e6c0-4626-a462-a28d61fa796a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:43.876782 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a8a4ef51-e6c0-4626-a462-a28d61fa796a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:43.882915 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8a4ef51-e6c0-4626-a462-a28d61fa796a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:43.883387 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8a4ef51-e6c0-4626-a462-a28d61fa796a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:43.884179 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8a4ef51-e6c0-4626-a462-a28d61fa796a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:43.884626 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8a4ef51-e6c0-4626-a462-a28d61fa796a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:44.082582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a8a4ef51-e6c0-4626-a462-a28d61fa796a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:44.090542 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a8a4ef51-e6c0-4626-a462-a28d61fa796a tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1512 microversion: 2.1 time: 0.227809 Jan 28 01:01:44.091158 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 252/542] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:43 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:44.877552 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fc5bc9c9-0aaa-4312-966a-1da2f23ff5a5 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:44.878136 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fc5bc9c9-0aaa-4312-966a-1da2f23ff5a5 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:44.884563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc5bc9c9-0aaa-4312-966a-1da2f23ff5a5 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:44.885023 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc5bc9c9-0aaa-4312-966a-1da2f23ff5a5 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:44.885893 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc5bc9c9-0aaa-4312-966a-1da2f23ff5a5 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:44.886326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc5bc9c9-0aaa-4312-966a-1da2f23ff5a5 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:45.038766 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fc5bc9c9-0aaa-4312-966a-1da2f23ff5a5 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:45.048539 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fc5bc9c9-0aaa-4312-966a-1da2f23ff5a5 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.174665 Jan 28 01:01:45.049133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 291/543] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:44 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:45.108683 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-54aa9d13-2fe9-48ed-8f6b-86d51af9e22e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:45.109295 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-54aa9d13-2fe9-48ed-8f6b-86d51af9e22e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:45.116570 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54aa9d13-2fe9-48ed-8f6b-86d51af9e22e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:45.117344 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54aa9d13-2fe9-48ed-8f6b-86d51af9e22e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:45.118283 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54aa9d13-2fe9-48ed-8f6b-86d51af9e22e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:45.118862 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54aa9d13-2fe9-48ed-8f6b-86d51af9e22e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:45.139409 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-eb0bc056-24ce-4947-a4a5-ef3a4b867196 req-3ea3b2b0-7de1-4e90-8f80-7d6a75aaf4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cc0552-4336-498f-b444-cc4e6338c62f", "name": "network-vif-deleted", "tag": "2994a10b-5228-441d-8734-936c3bea9193"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:45.140995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:45.140995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:01:45.148920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-eb0bc056-24ce-4947-a4a5-ef3a4b867196 req-3ea3b2b0-7de1-4e90-8f80-7d6a75aaf4ef service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:45.149663 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-eb0bc056-24ce-4947-a4a5-ef3a4b867196 req-3ea3b2b0-7de1-4e90-8f80-7d6a75aaf4ef service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:45.163372 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-eb0bc056-24ce-4947-a4a5-ef3a4b867196 req-3ea3b2b0-7de1-4e90-8f80-7d6a75aaf4ef service nova] Creating event network-vif-deleted:2994a10b-5228-441d-8734-936c3bea9193 for instance 30cc0552-4336-498f-b444-cc4e6338c62f on hv-cinder-81689 Jan 28 01:01:45.169006 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-eb0bc056-24ce-4947-a4a5-ef3a4b867196 req-3ea3b2b0-7de1-4e90-8f80-7d6a75aaf4ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033360 Jan 28 01:01:45.170695 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 292/544] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:01:45.207075 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-54aa9d13-2fe9-48ed-8f6b-86d51af9e22e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765eed67607c4ffeb858eda201f9be4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa12e9e43b74e37b418bbc4806a875c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:45.221223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-54aa9d13-2fe9-48ed-8f6b-86d51af9e22e tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 200 len: 1470 microversion: 2.1 time: 0.117182 Jan 28 01:01:45.221841 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 253/545] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:45 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 1470 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:46.067836 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2195f1f4-352b-4ff4-bf6e-a0410815c6b7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:46.068522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2195f1f4-352b-4ff4-bf6e-a0410815c6b7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:46.075356 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2195f1f4-352b-4ff4-bf6e-a0410815c6b7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:46.075826 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2195f1f4-352b-4ff4-bf6e-a0410815c6b7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:46.076603 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2195f1f4-352b-4ff4-bf6e-a0410815c6b7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:46.077034 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2195f1f4-352b-4ff4-bf6e-a0410815c6b7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:46.207772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2195f1f4-352b-4ff4-bf6e-a0410815c6b7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:46.215662 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2195f1f4-352b-4ff4-bf6e-a0410815c6b7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.152458 Jan 28 01:01:46.216228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 293/546] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:46 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:46.239036 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-12f6f023-165d-4640-8e31-aef3d04e4e26 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:46.239686 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-12f6f023-165d-4640-8e31-aef3d04e4e26 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] [instance: 30cc0552-4336-498f-b444-cc4e6338c62f] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:46.252416 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-12f6f023-165d-4640-8e31-aef3d04e4e26 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:46.252887 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-12f6f023-165d-4640-8e31-aef3d04e4e26 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:46.253636 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-12f6f023-165d-4640-8e31-aef3d04e4e26 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:46.254081 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-12f6f023-165d-4640-8e31-aef3d04e4e26 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:46.267355 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-12f6f023-165d-4640-8e31-aef3d04e4e26 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] HTTP exception thrown: Instance 30cc0552-4336-498f-b444-cc4e6338c62f could not be found. Jan 28 01:01:46.267960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-12f6f023-165d-4640-8e31-aef3d04e4e26 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] Returning 404 to user: Instance 30cc0552-4336-498f-b444-cc4e6338c62f could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:01:46.268791 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-12f6f023-165d-4640-8e31-aef3d04e4e26 tempest-VolumesSnapshotTestJSON-1502636908 tempest-VolumesSnapshotTestJSON-1502636908-project] 10.222.0.78 "GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f" status: 404 len: 111 microversion: 2.1 time: 0.033666 Jan 28 01:01:46.269326 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 254/547] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:46 2022] GET /compute/v2.1/servers/30cc0552-4336-498f-b444-cc4e6338c62f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:01:47.233113 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d356abd5-03ac-47d4-a89b-1f7c017300c3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:47.233693 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d356abd5-03ac-47d4-a89b-1f7c017300c3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:47.240391 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d356abd5-03ac-47d4-a89b-1f7c017300c3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:47.240834 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d356abd5-03ac-47d4-a89b-1f7c017300c3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:47.241617 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d356abd5-03ac-47d4-a89b-1f7c017300c3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:47.242051 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d356abd5-03ac-47d4-a89b-1f7c017300c3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:47.378840 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d356abd5-03ac-47d4-a89b-1f7c017300c3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:47.386505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d356abd5-03ac-47d4-a89b-1f7c017300c3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.157449 Jan 28 01:01:47.387126 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 294/548] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:47 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:48.404055 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e9abc079-2495-4c39-9c7f-8b29e1aa00b3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:48.404660 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e9abc079-2495-4c39-9c7f-8b29e1aa00b3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:48.411039 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9abc079-2495-4c39-9c7f-8b29e1aa00b3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:48.411598 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9abc079-2495-4c39-9c7f-8b29e1aa00b3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:48.412395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9abc079-2495-4c39-9c7f-8b29e1aa00b3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:48.412837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9abc079-2495-4c39-9c7f-8b29e1aa00b3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:48.545152 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e9abc079-2495-4c39-9c7f-8b29e1aa00b3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:48.552670 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e9abc079-2495-4c39-9c7f-8b29e1aa00b3 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.152805 Jan 28 01:01:48.553231 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 255/549] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:48 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:49.508580 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-0dadc280-da9e-432b-af08-c65a173a7049 req-55a688e4-95ee-4111-a300-8d8dbc58ac20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19505ea2-2d12-47cf-9a5f-d5185a64ffc4", "name": "network-vif-plugged", "status": "completed", "tag": "7ee19dba-7e3e-494c-881c-7d8ecc7fabdc"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:49.510118 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:49.510118 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:01:49.518571 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-0dadc280-da9e-432b-af08-c65a173a7049 req-55a688e4-95ee-4111-a300-8d8dbc58ac20 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:49.519398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-0dadc280-da9e-432b-af08-c65a173a7049 req-55a688e4-95ee-4111-a300-8d8dbc58ac20 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:49.533809 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-0dadc280-da9e-432b-af08-c65a173a7049 req-55a688e4-95ee-4111-a300-8d8dbc58ac20 service nova] Creating event network-vif-plugged:7ee19dba-7e3e-494c-881c-7d8ecc7fabdc for instance 19505ea2-2d12-47cf-9a5f-d5185a64ffc4 on hv-cinder-81689 Jan 28 01:01:49.539782 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-0dadc280-da9e-432b-af08-c65a173a7049 req-55a688e4-95ee-4111-a300-8d8dbc58ac20 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035609 Jan 28 01:01:49.540388 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 295/550] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:49.572120 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ac934897-78cf-4e77-98f6-6a9ffe2c222a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:49.575944 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ac934897-78cf-4e77-98f6-6a9ffe2c222a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:49.589648 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ac934897-78cf-4e77-98f6-6a9ffe2c222a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:49.590481 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ac934897-78cf-4e77-98f6-6a9ffe2c222a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:49.591776 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ac934897-78cf-4e77-98f6-6a9ffe2c222a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:49.592354 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ac934897-78cf-4e77-98f6-6a9ffe2c222a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:49.751557 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7b7ff06b-fbda-4db5-9297-13ea51fa064b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:49.752664 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7b7ff06b-fbda-4db5-9297-13ea51fa064b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:49.761214 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7b7ff06b-fbda-4db5-9297-13ea51fa064b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:49.761932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7b7ff06b-fbda-4db5-9297-13ea51fa064b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:49.763310 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7b7ff06b-fbda-4db5-9297-13ea51fa064b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:49.764134 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7b7ff06b-fbda-4db5-9297-13ea51fa064b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:49.840325 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ac934897-78cf-4e77-98f6-6a9ffe2c222a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:49.851474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ac934897-78cf-4e77-98f6-6a9ffe2c222a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.285177 Jan 28 01:01:49.851907 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 256/551] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:49 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:49.976354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7b7ff06b-fbda-4db5-9297-13ea51fa064b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:49.991004 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7b7ff06b-fbda-4db5-9297-13ea51fa064b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1594 microversion: 2.1 time: 0.238857 Jan 28 01:01:49.991004 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 296/552] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:49 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1594 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:50.868717 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cb88ca0f-c1b9-4a54-bac3-eabaa17d4191 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:50.869345 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cb88ca0f-c1b9-4a54-bac3-eabaa17d4191 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:50.876440 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb88ca0f-c1b9-4a54-bac3-eabaa17d4191 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:50.876893 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb88ca0f-c1b9-4a54-bac3-eabaa17d4191 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:50.877698 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb88ca0f-c1b9-4a54-bac3-eabaa17d4191 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:50.878140 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb88ca0f-c1b9-4a54-bac3-eabaa17d4191 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:51.024120 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-cb88ca0f-c1b9-4a54-bac3-eabaa17d4191 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:51.032712 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cb88ca0f-c1b9-4a54-bac3-eabaa17d4191 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.167531 Jan 28 01:01:51.033310 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 257/553] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:50 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:52.049744 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3ef1137c-7a16-472a-8158-dec4a1609f5b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:52.050367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3ef1137c-7a16-472a-8158-dec4a1609f5b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:52.056855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3ef1137c-7a16-472a-8158-dec4a1609f5b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:52.057808 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3ef1137c-7a16-472a-8158-dec4a1609f5b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:52.058612 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3ef1137c-7a16-472a-8158-dec4a1609f5b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:52.059087 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3ef1137c-7a16-472a-8158-dec4a1609f5b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:52.291248 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3ef1137c-7a16-472a-8158-dec4a1609f5b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:52.299271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3ef1137c-7a16-472a-8158-dec4a1609f5b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.253316 Jan 28 01:01:52.300285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 297/554] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:52 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:52.314464 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-c94273ef-5c29-454e-9d2e-187882885105 req-f1de9266-2600-48f1-922a-078891c4a3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07b7f77-0d8d-444b-9cad-fed068cdafec", "tag": "aaf8455f-185c-4280-8718-72bf446c9dc1"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:52.316838 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:52.316838 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:01:52.326145 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-c94273ef-5c29-454e-9d2e-187882885105 req-f1de9266-2600-48f1-922a-078891c4a3c8 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:52.327273 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-c94273ef-5c29-454e-9d2e-187882885105 req-f1de9266-2600-48f1-922a-078891c4a3c8 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:52.340003 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-c94273ef-5c29-454e-9d2e-187882885105 req-f1de9266-2600-48f1-922a-078891c4a3c8 service nova] Creating event network-changed:aaf8455f-185c-4280-8718-72bf446c9dc1 for instance a07b7f77-0d8d-444b-9cad-fed068cdafec on hv-cinder-81689 Jan 28 01:01:52.345290 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-c94273ef-5c29-454e-9d2e-187882885105 req-f1de9266-2600-48f1-922a-078891c4a3c8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034745 Jan 28 01:01:52.345956 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 258/555] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:01:53.164156 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c0978524-aab1-46c7-8a8f-f7708faf05cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:53.164156 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c0978524-aab1-46c7-8a8f-f7708faf05cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:53.173170 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c0978524-aab1-46c7-8a8f-f7708faf05cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.173694 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c0978524-aab1-46c7-8a8f-f7708faf05cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.174917 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c0978524-aab1-46c7-8a8f-f7708faf05cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.175596 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c0978524-aab1-46c7-8a8f-f7708faf05cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.219530 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c0978524-aab1-46c7-8a8f-f7708faf05cc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments/a65516d4-3f00-4d44-8935-ea03afc115be" status: 200 len: 194 microversion: 2.20 time: 0.061037 Jan 28 01:01:53.226232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 298/556] 10.222.0.78 () {60 vars in 1453 bytes} [Fri Jan 28 01:01:53 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments/a65516d4-3f00-4d44-8935-ea03afc115be => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:01:53.318851 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3c869b5b-d6b0-4ad7-96bf-b56adc5a0843 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:53.320654 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3c869b5b-d6b0-4ad7-96bf-b56adc5a0843 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:53.325116 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4c50d2b3-d3c3-4063-988b-379fb14433b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:53.326003 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4c50d2b3-d3c3-4063-988b-379fb14433b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:53.334139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c50d2b3-d3c3-4063-988b-379fb14433b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.334756 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c50d2b3-d3c3-4063-988b-379fb14433b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.335908 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c50d2b3-d3c3-4063-988b-379fb14433b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.336474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c869b5b-d6b0-4ad7-96bf-b56adc5a0843 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.336844 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c50d2b3-d3c3-4063-988b-379fb14433b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.337378 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c869b5b-d6b0-4ad7-96bf-b56adc5a0843 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.338457 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c869b5b-d6b0-4ad7-96bf-b56adc5a0843 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.340074 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c869b5b-d6b0-4ad7-96bf-b56adc5a0843 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.491302 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-4c50d2b3-d3c3-4063-988b-379fb14433b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lazy-loading 'services' on Instance uuid b8ab5025-62f7-40d2-b976-95ed4c6f0499 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:53.602166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4c50d2b3-d3c3-4063-988b-379fb14433b3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments/a65516d4-3f00-4d44-8935-ea03afc115be" status: 202 len: 0 microversion: 2.20 time: 0.280569 Jan 28 01:01:53.602991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 299/557] 10.222.0.78 () {60 vars in 1456 bytes} [Fri Jan 28 01:01:53 2022] DELETE /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments/a65516d4-3f00-4d44-8935-ea03afc115be => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:01:53.609669 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f4def9e9-da2e-4c24-a28f-df7cd2ee5ca1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1723141066"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:53.610494 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f4def9e9-da2e-4c24-a28f-df7cd2ee5ca1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:53.624362 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f4def9e9-da2e-4c24-a28f-df7cd2ee5ca1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.625387 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f4def9e9-da2e-4c24-a28f-df7cd2ee5ca1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.626745 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f4def9e9-da2e-4c24-a28f-df7cd2ee5ca1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.627421 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f4def9e9-da2e-4c24-a28f-df7cd2ee5ca1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.741687 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3c869b5b-d6b0-4ad7-96bf-b56adc5a0843 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:53.757868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3c869b5b-d6b0-4ad7-96bf-b56adc5a0843 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1318 microversion: 2.1 time: 0.441255 Jan 28 01:01:53.759182 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 259/558] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:53 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:53.773383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d6dc81ad-5e21-4402-bbd8-007e23896ad6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:53.777594 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d6dc81ad-5e21-4402-bbd8-007e23896ad6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:53.795889 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d6dc81ad-5e21-4402-bbd8-007e23896ad6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.796366 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d6dc81ad-5e21-4402-bbd8-007e23896ad6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.797234 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d6dc81ad-5e21-4402-bbd8-007e23896ad6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:53.797984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d6dc81ad-5e21-4402-bbd8-007e23896ad6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:53.853627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d6dc81ad-5e21-4402-bbd8-007e23896ad6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092418 Jan 28 01:01:53.863759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 260/559] 10.222.0.78 () {60 vars in 1342 bytes} [Fri Jan 28 01:01:53 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:01:53.906981 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.network.security_group_api [None req-f4def9e9-da2e-4c24-a28f-df7cd2ee5ca1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Adding security group 94b90060-95e9-4a09-b32d-92635b5508a3 to port aaf8455f-185c-4280-8718-72bf446c9dc1 Jan 28 01:01:54.468682 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f4def9e9-da2e-4c24-a28f-df7cd2ee5ca1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "POST /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/action" status: 202 len: 0 microversion: 2.1 time: 0.860715 Jan 28 01:01:54.468682 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 300/560] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:01:53 2022] POST /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:01:54.489764 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-04f69611-e3c7-4c93-8151-6e353c455411 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:54.490479 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-6c70cc14-433b-4082-8f85-c45eb84aacf7 req-5d40dc5a-5e14-4741-81fe-486d3905e42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07b7f77-0d8d-444b-9cad-fed068cdafec", "tag": "aaf8455f-185c-4280-8718-72bf446c9dc1"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:54.491951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-04f69611-e3c7-4c93-8151-6e353c455411 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:54.495922 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:54.495922 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:01:54.511043 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-04f69611-e3c7-4c93-8151-6e353c455411 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:54.512190 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-04f69611-e3c7-4c93-8151-6e353c455411 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:54.514754 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-04f69611-e3c7-4c93-8151-6e353c455411 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:54.515307 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-04f69611-e3c7-4c93-8151-6e353c455411 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:54.519338 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-6c70cc14-433b-4082-8f85-c45eb84aacf7 req-5d40dc5a-5e14-4741-81fe-486d3905e42c service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:54.519936 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-6c70cc14-433b-4082-8f85-c45eb84aacf7 req-5d40dc5a-5e14-4741-81fe-486d3905e42c service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:54.539885 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-6c70cc14-433b-4082-8f85-c45eb84aacf7 req-5d40dc5a-5e14-4741-81fe-486d3905e42c service nova] Creating event network-changed:aaf8455f-185c-4280-8718-72bf446c9dc1 for instance a07b7f77-0d8d-444b-9cad-fed068cdafec on hv-cinder-81689 Jan 28 01:01:54.552832 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-6c70cc14-433b-4082-8f85-c45eb84aacf7 req-5d40dc5a-5e14-4741-81fe-486d3905e42c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073500 Jan 28 01:01:54.560151 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 261/561] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:54.767402 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-04f69611-e3c7-4c93-8151-6e353c455411 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:54.779045 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-04f69611-e3c7-4c93-8151-6e353c455411 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1760 microversion: 2.1 time: 0.298504 Jan 28 01:01:54.794909 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 301/562] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:54 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1760 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:54.795708 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-be8fbb4d-ffc5-470b-86c9-01fdc8d3413a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:54.795708 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-be8fbb4d-ffc5-470b-86c9-01fdc8d3413a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:54.797940 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-be8fbb4d-ffc5-470b-86c9-01fdc8d3413a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:54.798411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-be8fbb4d-ffc5-470b-86c9-01fdc8d3413a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:54.802255 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-be8fbb4d-ffc5-470b-86c9-01fdc8d3413a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:54.802740 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-be8fbb4d-ffc5-470b-86c9-01fdc8d3413a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:54.873602 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ce9e2dc7-688f-4aba-8d79-b0d8b1f5eb6c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:54.875185 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ce9e2dc7-688f-4aba-8d79-b0d8b1f5eb6c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:54.886048 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ce9e2dc7-688f-4aba-8d79-b0d8b1f5eb6c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:54.887413 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ce9e2dc7-688f-4aba-8d79-b0d8b1f5eb6c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:54.889926 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ce9e2dc7-688f-4aba-8d79-b0d8b1f5eb6c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:54.890430 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ce9e2dc7-688f-4aba-8d79-b0d8b1f5eb6c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:54.961840 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ce9e2dc7-688f-4aba-8d79-b0d8b1f5eb6c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085101 Jan 28 01:01:54.963725 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 302/563] 10.222.0.78 () {60 vars in 1342 bytes} [Fri Jan 28 01:01:54 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:01:55.101188 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-be8fbb4d-ffc5-470b-86c9-01fdc8d3413a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:55.111334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-be8fbb4d-ffc5-470b-86c9-01fdc8d3413a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1507 microversion: 2.1 time: 0.339532 Jan 28 01:01:55.112191 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 262/564] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:54 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:55.974914 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8a75c7ce-cbac-440d-a185-c4c878c2cb33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:55.975867 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8a75c7ce-cbac-440d-a185-c4c878c2cb33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:55.982682 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8a75c7ce-cbac-440d-a185-c4c878c2cb33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:55.983166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8a75c7ce-cbac-440d-a185-c4c878c2cb33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:55.983951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8a75c7ce-cbac-440d-a185-c4c878c2cb33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:55.984398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8a75c7ce-cbac-440d-a185-c4c878c2cb33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:56.012632 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8a75c7ce-cbac-440d-a185-c4c878c2cb33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041482 Jan 28 01:01:56.013301 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 303/565] 10.222.0.78 () {60 vars in 1342 bytes} [Fri Jan 28 01:01:55 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:56.070402 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3c475631-44e8-456f-9b50-efa497d457e9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:56.070984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3c475631-44e8-456f-9b50-efa497d457e9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:56.077997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c475631-44e8-456f-9b50-efa497d457e9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:56.078450 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c475631-44e8-456f-9b50-efa497d457e9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:56.079622 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c475631-44e8-456f-9b50-efa497d457e9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:56.079734 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c475631-44e8-456f-9b50-efa497d457e9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:56.113506 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3c475631-44e8-456f-9b50-efa497d457e9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:01:56.200085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3c475631-44e8-456f-9b50-efa497d457e9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 204 len: 0 microversion: 2.20 time: 0.133125 Jan 28 01:01:56.200867 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 263/566] 10.222.0.78 () {60 vars in 1279 bytes} [Fri Jan 28 01:01:56 2022] DELETE /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 01:01:56.209888 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:56.210855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:56.216850 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:56.217382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:56.218271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:56.218839 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:56.368138 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:56.379403 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:56.382260 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:56.384325 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e5ed1183-4866-4d15-b54b-bff823d33af1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.178282 Jan 28 01:01:56.386093 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 304/567] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:01:56 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:01:56.605610 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f656bc0c-ce38-410e-b051-09bf74fba40b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8731a0a-2f54-4645-951a-4c3d4f63dc7b"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:56.606469 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f656bc0c-ce38-410e-b051-09bf74fba40b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:56.613233 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f656bc0c-ce38-410e-b051-09bf74fba40b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:56.613763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f656bc0c-ce38-410e-b051-09bf74fba40b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:56.614766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f656bc0c-ce38-410e-b051-09bf74fba40b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:56.615307 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f656bc0c-ce38-410e-b051-09bf74fba40b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:56.902654 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f656bc0c-ce38-410e-b051-09bf74fba40b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "POST /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301454 Jan 28 01:01:56.903314 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 264/568] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:01:56 2022] POST /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:57.404963 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:57.405508 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:57.412305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:57.412758 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:57.413552 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:57.413992 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:57.555277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:57.564631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:57.566164 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:57.567467 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-91b65399-8e9a-4429-a8c8-94a70e8137fc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.166793 Jan 28 01:01:57.568041 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 305/569] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:01:57 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:01:58.587179 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:58.587896 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:58.595429 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:58.595889 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:58.596700 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:58.597144 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:58.739984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:58.748587 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:58.750084 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:58.751290 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-03d360ba-02cb-41c1-b302-e75abbbea20d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.169050 Jan 28 01:01:58.752287 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 265/570] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:01:58 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:01:59.769541 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:59.770182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:59.777953 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:59.778408 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:59.779271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:59.779712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:59.912043 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:59.919934 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:59.921458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:59.922620 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f6d3b355-50f3-4579-bd0c-3ad2afdd1bb7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.156898 Jan 28 01:01:59.923221 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 306/571] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:01:59 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:00.945114 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:00.945847 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:00.954623 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:00.955268 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:00.956495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:00.957272 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:01.112582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:01.121827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:01.123395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:01.124621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-eddadea8-5faa-4b5f-bf77-6cb49678333b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1723 microversion: 2.20 time: 0.183679 Jan 28 01:02:01.125200 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 266/572] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:00 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:02:02.143434 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:02.144675 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:02.157990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:02.158442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:02.159277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:02.159895 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:02.264689 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:02.295750 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:02.299749 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:02.301450 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1f51219e-7d03-4722-85dc-155d691d4be5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 200 len: 1655 microversion: 2.20 time: 0.161593 Jan 28 01:02:02.302495 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 307/573] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:02 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:02:02.377749 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-027f726a-05fc-46c8-b4a9-39ca62087fbc req-f12242b2-b443-4f65-b028-99d1ebb88d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8ab5025-62f7-40d2-b976-95ed4c6f0499", "name": "network-vif-deleted", "tag": "4018b024-2307-4179-b2ef-10369aaee53c"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:02.380451 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:02.380451 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:02:02.390630 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-027f726a-05fc-46c8-b4a9-39ca62087fbc req-f12242b2-b443-4f65-b028-99d1ebb88d3d service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:02.392980 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-027f726a-05fc-46c8-b4a9-39ca62087fbc req-f12242b2-b443-4f65-b028-99d1ebb88d3d service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:02.404999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-027f726a-05fc-46c8-b4a9-39ca62087fbc req-f12242b2-b443-4f65-b028-99d1ebb88d3d service nova] Creating event network-vif-deleted:4018b024-2307-4179-b2ef-10369aaee53c for instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 on hv-cinder-81689 Jan 28 01:02:02.411185 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-027f726a-05fc-46c8-b4a9-39ca62087fbc req-f12242b2-b443-4f65-b028-99d1ebb88d3d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037889 Jan 28 01:02:02.411885 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 267/574] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:03.320530 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6a70f172-d2bc-4fa2-a0c5-fc089bdf0776 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:03.321144 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6a70f172-d2bc-4fa2-a0c5-fc089bdf0776 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:03.331417 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a70f172-d2bc-4fa2-a0c5-fc089bdf0776 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:03.332494 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a70f172-d2bc-4fa2-a0c5-fc089bdf0776 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:03.334269 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a70f172-d2bc-4fa2-a0c5-fc089bdf0776 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:03.335034 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a70f172-d2bc-4fa2-a0c5-fc089bdf0776 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:03.351306 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-6a70f172-d2bc-4fa2-a0c5-fc089bdf0776 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] HTTP exception thrown: Instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 could not be found. Jan 28 01:02:03.352008 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6a70f172-d2bc-4fa2-a0c5-fc089bdf0776 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Returning 404 to user: Instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:02:03.353214 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6a70f172-d2bc-4fa2-a0c5-fc089bdf0776 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 404 len: 111 microversion: 2.20 time: 0.036432 Jan 28 01:02:03.358134 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 308/575] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:03 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:02:03.364191 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-10cf67b2-0009-46c7-83de-fae393794085 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '.version_select at 0x7f1a0926aee0>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:03.393936 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-10cf67b2-0009-46c7-83de-fae393794085 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777780224" status: 204 len: 0 microversion: 2.20 time: 0.031126 Jan 28 01:02:03.395628 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 268/576] 10.222.0.78 () {60 vars in 1261 bytes} [Fri Jan 28 01:02:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777780224 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 01:02:04.423097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-540ea542-c3c6-4a60-aa15-1c0428541df3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'create', calling method: .version_select at 0x7f1a092a9160>, body: {"keypair": {"name": "tempest-keypair-1393450532"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:04.443364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-540ea542-c3c6-4a60-aa15-1c0428541df3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for project d1619efcedc544fabe3b60eef955ce40. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:04.449145 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-540ea542-c3c6-4a60-aa15-1c0428541df3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for user 3f4f91c9bc9d45cd8bea88e4c59c70ae and project d1619efcedc544fabe3b60eef955ce40. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:04.532931 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-224464927", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "networks": [{"uuid": "8d64b8b0-7739-4455-9d0c-091754eae844"}]}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:04.598587 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] validate_networks() for [('8d64b8b0-7739-4455-9d0c-091754eae844', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:02:04.710458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-540ea542-c3c6-4a60-aa15-1c0428541df3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for project d1619efcedc544fabe3b60eef955ce40. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:04.715880 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-540ea542-c3c6-4a60-aa15-1c0428541df3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for user 3f4f91c9bc9d45cd8bea88e4c59c70ae and project d1619efcedc544fabe3b60eef955ce40. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:04.731124 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-540ea542-c3c6-4a60-aa15-1c0428541df3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.314722 Jan 28 01:02:04.737247 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 309/577] 10.222.0.78 () {62 vars in 1198 bytes} [Fri Jan 28 01:02:04 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 316 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 28 01:02:05.344626 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:02:05.345166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:02:05.345689 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:02:05.346194 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:02:05.350249 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:02:05.362530 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:05.363289 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:05.364329 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:05.365154 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:05.404934 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Getting quotas for project 433c6f07b086479f94f16f5314942da7. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:05.414107 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Getting quotas for user 957a7c1ed6e045fdb3252969ea163b24 and project 433c6f07b086479f94f16f5314942da7. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:05.428699 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:02:05.433121 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:02:05.509733 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-741aa780-0068-4778-9d8a-7bf9efd9b0bf tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980669 Jan 28 01:02:05.511303 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 269/578] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:02:05.523492 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-74cd673a-267d-4501-bcad-21efd74bf194 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:05.524734 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-74cd673a-267d-4501-bcad-21efd74bf194 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:05.653038 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-74cd673a-267d-4501-bcad-21efd74bf194 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:05.661952 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-74cd673a-267d-4501-bcad-21efd74bf194 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1217 microversion: 2.1 time: 0.143832 Jan 28 01:02:05.664510 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 310/579] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:05 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:06.517405 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-610588726", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1773e64-668d-4b4c-97fa-e06f64eac702"}], "security_groups": [{"name": "tempest-securitygroup--1510720453"}], "key_name": "tempest-keypair-1393450532", "user_data": "}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:06.638609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] validate_networks() for [('d1773e64-668d-4b4c-97fa-e06f64eac702', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:02:06.682032 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-be938646-d9f4-4946-8827-d25ed9c1ed28 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:06.683326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-be938646-d9f4-4946-8827-d25ed9c1ed28 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:06.695756 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-be938646-d9f4-4946-8827-d25ed9c1ed28 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:06.696971 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-be938646-d9f4-4946-8827-d25ed9c1ed28 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:06.698175 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-be938646-d9f4-4946-8827-d25ed9c1ed28 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:06.698671 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-be938646-d9f4-4946-8827-d25ed9c1ed28 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:06.770943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-be938646-d9f4-4946-8827-d25ed9c1ed28 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:06.779012 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-be938646-d9f4-4946-8827-d25ed9c1ed28 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1277 microversion: 2.1 time: 0.101028 Jan 28 01:02:06.779879 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 311/580] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:06 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:07.264582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:02:07.264979 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:02:07.265459 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:02:07.265875 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:02:07.266295 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:02:07.276731 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:07.277238 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:07.278069 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:07.278496 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:07.297889 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for project d1619efcedc544fabe3b60eef955ce40. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:07.302549 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Getting quotas for user 3f4f91c9bc9d45cd8bea88e4c59c70ae and project d1619efcedc544fabe3b60eef955ce40. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:07.320247 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:02:07.323537 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:02:07.386126 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f4e5ba4b-a023-4820-9766-510ea442b0b5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.872926 Jan 28 01:02:07.387835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 270/581] 10.222.0.78 () {62 vars in 1187 bytes} [Fri Jan 28 01:02:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 01:02:07.398005 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8113d2c4-d74c-4e22-a017-e66daaa7bb49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:07.399331 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8113d2c4-d74c-4e22-a017-e66daaa7bb49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:07.461130 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8113d2c4-d74c-4e22-a017-e66daaa7bb49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:07.468546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8113d2c4-d74c-4e22-a017-e66daaa7bb49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:07.470075 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8113d2c4-d74c-4e22-a017-e66daaa7bb49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:07.471227 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8113d2c4-d74c-4e22-a017-e66daaa7bb49 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1281 microversion: 2.20 time: 0.077027 Jan 28 01:02:07.471790 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 312/582] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:07 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:07.804355 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5cad5ead-b846-41eb-bcb2-76a87e903f41 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:07.806076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5cad5ead-b846-41eb-bcb2-76a87e903f41 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:07.816809 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5cad5ead-b846-41eb-bcb2-76a87e903f41 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:07.817360 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5cad5ead-b846-41eb-bcb2-76a87e903f41 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:07.818341 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5cad5ead-b846-41eb-bcb2-76a87e903f41 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:07.818861 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5cad5ead-b846-41eb-bcb2-76a87e903f41 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:08.118100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5cad5ead-b846-41eb-bcb2-76a87e903f41 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:08.129533 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5cad5ead-b846-41eb-bcb2-76a87e903f41 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1317 microversion: 2.1 time: 0.331414 Jan 28 01:02:08.130270 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 271/583] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:07 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:08.493071 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:08.493720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:08.502774 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:08.502774 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:08.503187 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:08.503822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:08.537020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-c81f549c-6f8d-417e-8a53-4c9a57075abb req-e4e64b4c-958c-4758-a96a-d721cabc317b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df026b29-203d-4492-892d-45774a906b25", "tag": "e1715f83-ff51-4c85-b157-6651e8b0d99a"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:08.539466 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:08.539466 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:02:08.554864 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-c81f549c-6f8d-417e-8a53-4c9a57075abb req-e4e64b4c-958c-4758-a96a-d721cabc317b service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:08.555469 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-c81f549c-6f8d-417e-8a53-4c9a57075abb req-e4e64b4c-958c-4758-a96a-d721cabc317b service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:08.582426 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-c81f549c-6f8d-417e-8a53-4c9a57075abb req-e4e64b4c-958c-4758-a96a-d721cabc317b service nova] Creating event network-changed:e1715f83-ff51-4c85-b157-6651e8b0d99a for instance df026b29-203d-4492-892d-45774a906b25 on hv-cinder-81689 Jan 28 01:02:08.584519 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:08.589908 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-c81f549c-6f8d-417e-8a53-4c9a57075abb req-e4e64b4c-958c-4758-a96a-d721cabc317b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057933 Jan 28 01:02:08.590540 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 272/584] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:08.595573 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:08.599078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:08.600915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-eac2ac0e-f876-4496-aa24-78e4098f0f8e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1333 microversion: 2.20 time: 0.111556 Jan 28 01:02:08.607061 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 313/585] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:08 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:09.147129 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e80fba4e-b58a-49e3-a666-6be6f538b63e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:09.147833 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e80fba4e-b58a-49e3-a666-6be6f538b63e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:09.155622 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e80fba4e-b58a-49e3-a666-6be6f538b63e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:09.156427 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e80fba4e-b58a-49e3-a666-6be6f538b63e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:09.157374 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e80fba4e-b58a-49e3-a666-6be6f538b63e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:09.158307 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e80fba4e-b58a-49e3-a666-6be6f538b63e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:09.539563 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e80fba4e-b58a-49e3-a666-6be6f538b63e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:09.551783 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e80fba4e-b58a-49e3-a666-6be6f538b63e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1317 microversion: 2.1 time: 0.408366 Jan 28 01:02:09.552969 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 273/586] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:09 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:09.620246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:09.620921 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:09.627404 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:09.627865 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:09.628713 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:09.629176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:09.692177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:09.700802 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:09.702354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:09.703634 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-34896ea1-7ce8-4af1-aaf0-467e408d4a21 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1339 microversion: 2.20 time: 0.087591 Jan 28 01:02:09.704202 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 314/587] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:09 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:10.577546 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9d1ef536-883e-4ebb-90e8-183c6bdb8300 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:10.578343 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9d1ef536-883e-4ebb-90e8-183c6bdb8300 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:10.586051 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d1ef536-883e-4ebb-90e8-183c6bdb8300 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:10.586507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d1ef536-883e-4ebb-90e8-183c6bdb8300 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:10.587624 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d1ef536-883e-4ebb-90e8-183c6bdb8300 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:10.588082 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9d1ef536-883e-4ebb-90e8-183c6bdb8300 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:10.722076 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:10.722744 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:10.730364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:10.731070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:10.731874 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:10.732316 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:10.897714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:10.906749 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:10.908441 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:10.909762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-108ec541-73b5-434f-b2ec-f0dfba454c00 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1407 microversion: 2.20 time: 0.191569 Jan 28 01:02:10.914081 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 315/588] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:10 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:02:11.064877 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-9d1ef536-883e-4ebb-90e8-183c6bdb8300 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:11.073267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9d1ef536-883e-4ebb-90e8-183c6bdb8300 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1317 microversion: 2.1 time: 0.500338 Jan 28 01:02:11.073961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 274/589] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:10 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:11.176731 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-ba7b15ca-5d6a-406c-9518-16a80ae4b68a req-d89d96b6-aec6-44d2-a146-fd1d2d50638e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bff9f97-2065-4e4e-8e55-28563a35288c", "tag": "70dfd08a-1b60-4f24-ac93-be76036044f2"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:11.179357 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:11.179357 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:02:11.187291 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-ba7b15ca-5d6a-406c-9518-16a80ae4b68a req-d89d96b6-aec6-44d2-a146-fd1d2d50638e service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:11.188112 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-ba7b15ca-5d6a-406c-9518-16a80ae4b68a req-d89d96b6-aec6-44d2-a146-fd1d2d50638e service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:11.204708 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-ba7b15ca-5d6a-406c-9518-16a80ae4b68a req-d89d96b6-aec6-44d2-a146-fd1d2d50638e service nova] Creating event network-changed:70dfd08a-1b60-4f24-ac93-be76036044f2 for instance 2bff9f97-2065-4e4e-8e55-28563a35288c on hv-cinder-81689 Jan 28 01:02:11.212798 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-ba7b15ca-5d6a-406c-9518-16a80ae4b68a req-d89d96b6-aec6-44d2-a146-fd1d2d50638e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040066 Jan 28 01:02:11.218453 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 316/590] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:11.930463 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:11.931189 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:11.940117 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:11.940648 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:11.941568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:11.942106 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:12.098447 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-cf6114ab-891c-4863-b011-715120698c45 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:12.099802 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-cf6114ab-891c-4863-b011-715120698c45 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:12.108443 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cf6114ab-891c-4863-b011-715120698c45 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:12.109229 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cf6114ab-891c-4863-b011-715120698c45 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:12.111258 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cf6114ab-891c-4863-b011-715120698c45 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:12.111910 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cf6114ab-891c-4863-b011-715120698c45 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:12.205097 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:12.214413 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:12.216207 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:12.217401 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0b83c4f1-ef75-4620-9714-e6ca75283942 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1407 microversion: 2.20 time: 0.291605 Jan 28 01:02:12.217977 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 275/591] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:11 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:02:12.340961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-cf6114ab-891c-4863-b011-715120698c45 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:12.350752 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-cf6114ab-891c-4863-b011-715120698c45 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1317 microversion: 2.1 time: 0.264290 Jan 28 01:02:12.361254 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 317/592] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:12 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:13.237714 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:13.238348 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:13.245631 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:13.246072 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:13.246854 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:13.247496 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:13.368130 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-35b4820f-b810-42ed-99bc-9525e8a7349c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:13.368750 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-35b4820f-b810-42ed-99bc-9525e8a7349c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:13.376027 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-35b4820f-b810-42ed-99bc-9525e8a7349c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:13.376488 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-35b4820f-b810-42ed-99bc-9525e8a7349c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:13.377296 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-35b4820f-b810-42ed-99bc-9525e8a7349c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:13.377737 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-35b4820f-b810-42ed-99bc-9525e8a7349c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:13.390669 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:13.400215 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:13.402145 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:13.403870 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-79dd8a91-9427-4806-a479-f6a1317711cb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1407 microversion: 2.20 time: 0.169399 Jan 28 01:02:13.413878 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 276/593] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:13 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:13.536228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-35b4820f-b810-42ed-99bc-9525e8a7349c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:13.543918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-35b4820f-b810-42ed-99bc-9525e8a7349c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1317 microversion: 2.1 time: 0.179408 Jan 28 01:02:13.544819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 318/594] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:13 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:13.780009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-1aab7d77-58c8-4396-9c0f-56f2da81e301 req-b1eb127e-9e3b-4dad-908b-87190bec0836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df026b29-203d-4492-892d-45774a906b25", "name": "network-vif-plugged", "status": "completed", "tag": "e1715f83-ff51-4c85-b157-6651e8b0d99a"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:13.781860 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:13.781860 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:02:13.789365 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-1aab7d77-58c8-4396-9c0f-56f2da81e301 req-b1eb127e-9e3b-4dad-908b-87190bec0836 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:13.789816 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-1aab7d77-58c8-4396-9c0f-56f2da81e301 req-b1eb127e-9e3b-4dad-908b-87190bec0836 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:13.801745 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-1aab7d77-58c8-4396-9c0f-56f2da81e301 req-b1eb127e-9e3b-4dad-908b-87190bec0836 service nova] Creating event network-vif-plugged:e1715f83-ff51-4c85-b157-6651e8b0d99a for instance df026b29-203d-4492-892d-45774a906b25 on hv-cinder-81689 Jan 28 01:02:13.806609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-1aab7d77-58c8-4396-9c0f-56f2da81e301 req-b1eb127e-9e3b-4dad-908b-87190bec0836 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030752 Jan 28 01:02:13.808019 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 277/595] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:14.421964 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:14.428563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:14.436293 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:14.436896 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:14.437860 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:14.438414 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:14.568205 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-38a6ac0c-289e-4b11-861c-967cf0bdfe67 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:14.570015 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-38a6ac0c-289e-4b11-861c-967cf0bdfe67 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:14.590907 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-38a6ac0c-289e-4b11-861c-967cf0bdfe67 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:14.591688 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-38a6ac0c-289e-4b11-861c-967cf0bdfe67 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:14.592747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-38a6ac0c-289e-4b11-861c-967cf0bdfe67 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:14.593248 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-38a6ac0c-289e-4b11-861c-967cf0bdfe67 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:14.639969 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:14.652600 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:14.655551 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:14.657624 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d63e5c5e-6144-488e-b6e3-453e8336da55 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1407 microversion: 2.20 time: 0.239355 Jan 28 01:02:14.668532 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 319/596] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:14 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:14.730359 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-38a6ac0c-289e-4b11-861c-967cf0bdfe67 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:14.737870 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-38a6ac0c-289e-4b11-861c-967cf0bdfe67 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1317 microversion: 2.1 time: 0.179518 Jan 28 01:02:14.738752 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 278/597] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:14 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:15.677646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:15.679176 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:15.693462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:15.695049 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:15.696084 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:15.697037 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:15.755089 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-51c10f92-5e11-4741-a7e4-d888e3238020 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:15.756419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-51c10f92-5e11-4741-a7e4-d888e3238020 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:15.766284 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-51c10f92-5e11-4741-a7e4-d888e3238020 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:15.767206 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-51c10f92-5e11-4741-a7e4-d888e3238020 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:15.768661 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-51c10f92-5e11-4741-a7e4-d888e3238020 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:15.769266 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-51c10f92-5e11-4741-a7e4-d888e3238020 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:15.909567 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-51c10f92-5e11-4741-a7e4-d888e3238020 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:15.917877 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-51c10f92-5e11-4741-a7e4-d888e3238020 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1506 microversion: 2.1 time: 0.166660 Jan 28 01:02:15.918461 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 279/598] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:15 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:15.923294 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-a28ef08f-c418-40bb-81fc-c30406f7ef6d req-b8dc3184-aa51-4995-9e2c-82e314e44b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff9f97-2065-4e4e-8e55-28563a35288c", "name": "network-vif-plugged", "status": "completed", "tag": "70dfd08a-1b60-4f24-ac93-be76036044f2"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:15.924981 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:15.924981 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:02:15.933219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-a28ef08f-c418-40bb-81fc-c30406f7ef6d req-b8dc3184-aa51-4995-9e2c-82e314e44b82 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:15.934026 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-a28ef08f-c418-40bb-81fc-c30406f7ef6d req-b8dc3184-aa51-4995-9e2c-82e314e44b82 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:15.946843 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-a28ef08f-c418-40bb-81fc-c30406f7ef6d req-b8dc3184-aa51-4995-9e2c-82e314e44b82 service nova] Creating event network-vif-plugged:70dfd08a-1b60-4f24-ac93-be76036044f2 for instance 2bff9f97-2065-4e4e-8e55-28563a35288c on hv-cinder-81689 Jan 28 01:02:15.952572 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-a28ef08f-c418-40bb-81fc-c30406f7ef6d req-b8dc3184-aa51-4995-9e2c-82e314e44b82 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Jan 28 01:02:15.953682 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 280/599] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:15.959844 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-98de95ae-cd7f-4cb4-904b-121d624013ff tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8731a0a-2f54-4645-951a-4c3d4f63dc7b"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:15.961107 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-98de95ae-cd7f-4cb4-904b-121d624013ff tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:15.970460 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-98de95ae-cd7f-4cb4-904b-121d624013ff tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:15.971063 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-98de95ae-cd7f-4cb4-904b-121d624013ff tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:15.972427 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-98de95ae-cd7f-4cb4-904b-121d624013ff tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:15.972932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:15.973452 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-98de95ae-cd7f-4cb4-904b-121d624013ff tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:15.983384 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:15.984975 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:15.986114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e9d2d885-c0ca-4ee3-bac4-d61c50b1549a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1407 microversion: 2.20 time: 0.313089 Jan 28 01:02:15.986723 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 320/600] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:15 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:16.085821 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-98de95ae-cd7f-4cb4-904b-121d624013ff tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] HTTP exception thrown: Invalid volume: volume c8731a0a-2f54-4645-951a-4c3d4f63dc7b is already attached to instances: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4 Jan 28 01:02:16.086685 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-98de95ae-cd7f-4cb4-904b-121d624013ff tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Returning 400 to user: Invalid volume: volume c8731a0a-2f54-4645-951a-4c3d4f63dc7b is already attached to instances: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4 {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:02:16.088663 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-98de95ae-cd7f-4cb4-904b-121d624013ff tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "POST /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.133182 Jan 28 01:02:16.089240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 281/601] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:02:15 2022] POST /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25/os-volume_attachments => generated 174 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:02:16.159638 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-977b07c5-21d0-4d17-9efa-07612c511942 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:16.160328 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-977b07c5-21d0-4d17-9efa-07612c511942 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:16.169382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-977b07c5-21d0-4d17-9efa-07612c511942 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:16.169847 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-977b07c5-21d0-4d17-9efa-07612c511942 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:16.183695 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-977b07c5-21d0-4d17-9efa-07612c511942 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:16.183695 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-977b07c5-21d0-4d17-9efa-07612c511942 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:16.277607 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-977b07c5-21d0-4d17-9efa-07612c511942 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lazy-loading 'services' on Instance uuid 19505ea2-2d12-47cf-9a5f-d5185a64ffc4 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:02:16.359368 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-977b07c5-21d0-4d17-9efa-07612c511942 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "DELETE /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments/c8731a0a-2f54-4645-951a-4c3d4f63dc7b" status: 202 len: 0 microversion: 2.1 time: 0.203942 Jan 28 01:02:16.360491 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 321/602] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:02:16 2022] DELETE /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments/c8731a0a-2f54-4645-951a-4c3d4f63dc7b => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:16.371901 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-fc169bf9-5006-4258-a119-59cff132bc90 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:16.373514 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-fc169bf9-5006-4258-a119-59cff132bc90 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:16.385397 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc169bf9-5006-4258-a119-59cff132bc90 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:16.386983 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc169bf9-5006-4258-a119-59cff132bc90 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:16.387976 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc169bf9-5006-4258-a119-59cff132bc90 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:16.388425 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fc169bf9-5006-4258-a119-59cff132bc90 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:16.441428 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-fc169bf9-5006-4258-a119-59cff132bc90 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075882 Jan 28 01:02:16.442488 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 282/603] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:02:16 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:17.007085 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:17.008058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:17.022690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:17.025202 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:17.027411 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:17.028146 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:17.201872 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:17.242917 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:17.248617 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:17.249777 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6a222575-4924-4340-90fc-20dc18a6239c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1407 microversion: 2.20 time: 0.248340 Jan 28 01:02:17.263256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 322/604] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:17 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:17.458608 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2dfeb451-9577-45e7-be1b-153ea2e1befd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:17.459579 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2dfeb451-9577-45e7-be1b-153ea2e1befd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:17.467673 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2dfeb451-9577-45e7-be1b-153ea2e1befd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:17.468363 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2dfeb451-9577-45e7-be1b-153ea2e1befd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:17.469728 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2dfeb451-9577-45e7-be1b-153ea2e1befd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:17.470496 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2dfeb451-9577-45e7-be1b-153ea2e1befd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:17.512909 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2dfeb451-9577-45e7-be1b-153ea2e1befd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060149 Jan 28 01:02:17.513159 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 283/605] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:02:17 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:18.268250 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:18.268863 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:18.277142 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:18.277669 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:18.278689 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:18.279200 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:18.466716 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:18.479890 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:18.481446 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:18.482640 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-14f41f9b-45c4-4510-8eb5-0f21ef41f0e5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1598 microversion: 2.20 time: 0.218730 Jan 28 01:02:18.483935 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 323/606] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:02:18 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1598 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:18.500603 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-104f9e21-c278-48e6-8e0b-c9a45e7ccc04 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:18.501326 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-104f9e21-c278-48e6-8e0b-c9a45e7ccc04 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:18.508027 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-104f9e21-c278-48e6-8e0b-c9a45e7ccc04 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:18.508483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-104f9e21-c278-48e6-8e0b-c9a45e7ccc04 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:18.509290 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-104f9e21-c278-48e6-8e0b-c9a45e7ccc04 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:18.509790 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-104f9e21-c278-48e6-8e0b-c9a45e7ccc04 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:18.524970 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9a6dd645-1b6f-49ea-b277-e623cebc7c8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:18.526987 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9a6dd645-1b6f-49ea-b277-e623cebc7c8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:18.537266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9a6dd645-1b6f-49ea-b277-e623cebc7c8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:18.537720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9a6dd645-1b6f-49ea-b277-e623cebc7c8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:18.541772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9a6dd645-1b6f-49ea-b277-e623cebc7c8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:18.543777 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9a6dd645-1b6f-49ea-b277-e623cebc7c8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:18.609903 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9a6dd645-1b6f-49ea-b277-e623cebc7c8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089784 Jan 28 01:02:18.621625 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 324/607] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:02:18 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:02:18.647320 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-104f9e21-c278-48e6-8e0b-c9a45e7ccc04 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.149908 Jan 28 01:02:18.655073 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 284/608] 10.222.0.78 () {60 vars in 1315 bytes} [Fri Jan 28 01:02:18 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:02:18.805578 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-697476830", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "networks": [{"uuid": "8d64b8b0-7739-4455-9d0c-091754eae844"}]}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:18.878976 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] validate_networks() for [('8d64b8b0-7739-4455-9d0c-091754eae844', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:02:19.466255 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:02:19.467981 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:02:19.469047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:02:19.469779 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:02:19.470734 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:02:19.488867 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:19.489318 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:19.491338 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:19.492478 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:19.537991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Getting quotas for project 433c6f07b086479f94f16f5314942da7. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:19.544551 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Getting quotas for user 957a7c1ed6e045fdb3252969ea163b24 and project 433c6f07b086479f94f16f5314942da7. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:19.560970 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:02:19.563922 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:02:19.626776 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-bf344120-25d4-4c5b-89c7-0ae6f9555840 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825317 Jan 28 01:02:19.630923 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 325/609] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:02:19.648250 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-270a825c-581c-4c53-af29-5f4a513fe3ef tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:19.650713 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-270a825c-581c-4c53-af29-5f4a513fe3ef tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:19.752238 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-270a825c-581c-4c53-af29-5f4a513fe3ef tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:19.775912 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-270a825c-581c-4c53-af29-5f4a513fe3ef tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1217 microversion: 2.1 time: 0.137075 Jan 28 01:02:19.779971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 285/610] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:19 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:20.131631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bef325a6-d070-486d-8245-f06723d09168 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:20.131891 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-4bd857eb-bea9-4aa5-8b7e-4ac685afe6f9 req-f878ba21-bb48-40a7-b121-51302b0a6832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bff9f97-2065-4e4e-8e55-28563a35288c", "tag": "70dfd08a-1b60-4f24-ac93-be76036044f2"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:20.133336 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:20.133336 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:02:20.136292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bef325a6-d070-486d-8245-f06723d09168 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:20.142242 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-4bd857eb-bea9-4aa5-8b7e-4ac685afe6f9 req-f878ba21-bb48-40a7-b121-51302b0a6832 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:20.144091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-4bd857eb-bea9-4aa5-8b7e-4ac685afe6f9 req-f878ba21-bb48-40a7-b121-51302b0a6832 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:20.156956 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-4bd857eb-bea9-4aa5-8b7e-4ac685afe6f9 req-f878ba21-bb48-40a7-b121-51302b0a6832 service nova] Creating event network-changed:70dfd08a-1b60-4f24-ac93-be76036044f2 for instance 2bff9f97-2065-4e4e-8e55-28563a35288c on hv-cinder-81689 Jan 28 01:02:20.163422 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-4bd857eb-bea9-4aa5-8b7e-4ac685afe6f9 req-f878ba21-bb48-40a7-b121-51302b0a6832 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035996 Jan 28 01:02:20.169622 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 286/611] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:20.173673 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bef325a6-d070-486d-8245-f06723d09168 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:20.174217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bef325a6-d070-486d-8245-f06723d09168 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:20.175066 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bef325a6-d070-486d-8245-f06723d09168 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:20.175534 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bef325a6-d070-486d-8245-f06723d09168 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:20.331832 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-bef325a6-d070-486d-8245-f06723d09168 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.205332 Jan 28 01:02:20.333263 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 326/612] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:20 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:20.366930 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0eac34f7-25b1-4393-b473-36f920e7956b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:20.367984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0eac34f7-25b1-4393-b473-36f920e7956b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:20.389804 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0eac34f7-25b1-4393-b473-36f920e7956b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:20.391318 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0eac34f7-25b1-4393-b473-36f920e7956b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:20.392223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0eac34f7-25b1-4393-b473-36f920e7956b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:20.392713 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0eac34f7-25b1-4393-b473-36f920e7956b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:20.601724 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0eac34f7-25b1-4393-b473-36f920e7956b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "POST /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/action" status: 202 len: 0 microversion: 2.1 time: 0.238646 Jan 28 01:02:20.604356 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 287/613] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:02:20 2022] POST /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:20.613190 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a5b310ab-6176-436d-a647-50e4c02c491f tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:20.614110 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a5b310ab-6176-436d-a647-50e4c02c491f tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:20.628976 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a5b310ab-6176-436d-a647-50e4c02c491f tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:20.629547 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a5b310ab-6176-436d-a647-50e4c02c491f tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:20.631800 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a5b310ab-6176-436d-a647-50e4c02c491f tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:20.632707 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a5b310ab-6176-436d-a647-50e4c02c491f tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:20.808603 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4191e7dc-4141-4c48-b69e-104fcd6650d6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:20.809769 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4191e7dc-4141-4c48-b69e-104fcd6650d6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:20.839511 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4191e7dc-4141-4c48-b69e-104fcd6650d6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:20.842404 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4191e7dc-4141-4c48-b69e-104fcd6650d6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:20.843255 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4191e7dc-4141-4c48-b69e-104fcd6650d6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:20.844062 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4191e7dc-4141-4c48-b69e-104fcd6650d6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:21.116886 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a5b310ab-6176-436d-a647-50e4c02c491f tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:21.193535 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a5b310ab-6176-436d-a647-50e4c02c491f tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1752 microversion: 2.1 time: 0.584194 Jan 28 01:02:21.199000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 327/614] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:20 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1752 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:21.344194 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4eadde0c-2b00-4ca7-bd87-c9923d23652c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:21.345652 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4eadde0c-2b00-4ca7-bd87-c9923d23652c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:21.357255 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4eadde0c-2b00-4ca7-bd87-c9923d23652c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:21.359305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4eadde0c-2b00-4ca7-bd87-c9923d23652c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:21.361792 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4eadde0c-2b00-4ca7-bd87-c9923d23652c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:21.364643 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4eadde0c-2b00-4ca7-bd87-c9923d23652c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:21.372595 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4191e7dc-4141-4c48-b69e-104fcd6650d6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:21.396690 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4191e7dc-4141-4c48-b69e-104fcd6650d6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1269 microversion: 2.1 time: 0.594414 Jan 28 01:02:21.406397 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 288/615] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:20 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1269 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:21.515909 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4eadde0c-2b00-4ca7-bd87-c9923d23652c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.175467 Jan 28 01:02:21.517257 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 328/616] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:21 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:22.231318 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-52ea0854-72df-4da8-98f3-6b4cefe71af9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:22.232265 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-52ea0854-72df-4da8-98f3-6b4cefe71af9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:22.252215 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-52ea0854-72df-4da8-98f3-6b4cefe71af9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:22.254859 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-52ea0854-72df-4da8-98f3-6b4cefe71af9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:22.257888 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-52ea0854-72df-4da8-98f3-6b4cefe71af9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:22.259230 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-52ea0854-72df-4da8-98f3-6b4cefe71af9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:22.439511 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-17c7276b-fa8a-4f57-9a8e-37e3d920236e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:22.441361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-17c7276b-fa8a-4f57-9a8e-37e3d920236e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:22.471372 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-17c7276b-fa8a-4f57-9a8e-37e3d920236e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:22.472809 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-17c7276b-fa8a-4f57-9a8e-37e3d920236e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:22.474032 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-17c7276b-fa8a-4f57-9a8e-37e3d920236e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:22.475151 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-17c7276b-fa8a-4f57-9a8e-37e3d920236e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:22.764322 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-52ea0854-72df-4da8-98f3-6b4cefe71af9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:22.781403 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-52ea0854-72df-4da8-98f3-6b4cefe71af9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1752 microversion: 2.1 time: 0.553474 Jan 28 01:02:22.782280 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 289/617] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:22 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1752 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:22.796422 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bc438033-6c2d-4666-926f-91f58a17aeec tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:22.799855 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-bc438033-6c2d-4666-926f-91f58a17aeec tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:22.815807 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bc438033-6c2d-4666-926f-91f58a17aeec tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:22.817828 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bc438033-6c2d-4666-926f-91f58a17aeec tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:22.824971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bc438033-6c2d-4666-926f-91f58a17aeec tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:22.825838 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bc438033-6c2d-4666-926f-91f58a17aeec tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:22.951507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bc438033-6c2d-4666-926f-91f58a17aeec tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.165366 Jan 28 01:02:22.957756 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 290/618] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:22 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:23.076135 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-17c7276b-fa8a-4f57-9a8e-37e3d920236e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:23.091506 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-17c7276b-fa8a-4f57-9a8e-37e3d920236e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1275 microversion: 2.1 time: 0.676533 Jan 28 01:02:23.094782 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 329/619] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:22 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1275 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:23.801411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2036e756-5ff8-4dcf-b281-ee4824a5146c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:23.805845 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2036e756-5ff8-4dcf-b281-ee4824a5146c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:23.852175 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2036e756-5ff8-4dcf-b281-ee4824a5146c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:23.855217 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2036e756-5ff8-4dcf-b281-ee4824a5146c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:23.861587 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2036e756-5ff8-4dcf-b281-ee4824a5146c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:23.866499 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2036e756-5ff8-4dcf-b281-ee4824a5146c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:23.974781 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ee0c9e21-e47f-40e2-9f86-fbb02e7af080 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:23.977729 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ee0c9e21-e47f-40e2-9f86-fbb02e7af080 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:24.004114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ee0c9e21-e47f-40e2-9f86-fbb02e7af080 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:24.006088 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ee0c9e21-e47f-40e2-9f86-fbb02e7af080 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:24.010097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ee0c9e21-e47f-40e2-9f86-fbb02e7af080 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:24.012683 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ee0c9e21-e47f-40e2-9f86-fbb02e7af080 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:24.152287 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2036e756-5ff8-4dcf-b281-ee4824a5146c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:24.163421 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ee0c9e21-e47f-40e2-9f86-fbb02e7af080 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.198982 Jan 28 01:02:24.164351 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 330/620] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:23 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:24.168212 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2036e756-5ff8-4dcf-b281-ee4824a5146c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.372018 Jan 28 01:02:24.169473 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 291/621] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:23 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:24.170081 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-23f207e4-bf92-42cb-aebe-0c887cad49ae tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:24.171059 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-23f207e4-bf92-42cb-aebe-0c887cad49ae tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:24.179093 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23f207e4-bf92-42cb-aebe-0c887cad49ae tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:24.186943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23f207e4-bf92-42cb-aebe-0c887cad49ae tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:24.187839 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23f207e4-bf92-42cb-aebe-0c887cad49ae tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:24.188479 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23f207e4-bf92-42cb-aebe-0c887cad49ae tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:24.502736 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-23f207e4-bf92-42cb-aebe-0c887cad49ae tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:24.515990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-23f207e4-bf92-42cb-aebe-0c887cad49ae tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1317 microversion: 2.1 time: 0.350152 Jan 28 01:02:24.521074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 331/622] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:24 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:24.739912 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-80b56be5-ae74-42bf-b338-1ee0a6048c43 req-8418c04a-4235-4813-866c-9da54b127c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31677564-4255-423a-b0c3-c971c15d7088", "tag": "7dc14b94-86ca-45c6-8d82-f843ddbc5a06"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:24.741685 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:24.741685 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:02:24.775795 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-80b56be5-ae74-42bf-b338-1ee0a6048c43 req-8418c04a-4235-4813-866c-9da54b127c5d service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:24.776261 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-80b56be5-ae74-42bf-b338-1ee0a6048c43 req-8418c04a-4235-4813-866c-9da54b127c5d service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:24.792390 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-80b56be5-ae74-42bf-b338-1ee0a6048c43 req-8418c04a-4235-4813-866c-9da54b127c5d service nova] Creating event network-changed:7dc14b94-86ca-45c6-8d82-f843ddbc5a06 for instance 31677564-4255-423a-b0c3-c971c15d7088 on hv-cinder-81689 Jan 28 01:02:24.802290 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-80b56be5-ae74-42bf-b338-1ee0a6048c43 req-8418c04a-4235-4813-866c-9da54b127c5d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065139 Jan 28 01:02:24.803997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 292/623] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:25.176955 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5182b563-f3bc-4c0f-b22d-c2eb02a23b67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:25.178456 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5182b563-f3bc-4c0f-b22d-c2eb02a23b67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:25.188824 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d57cdcf0-5a72-44ff-9b9b-05de5b4974b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:25.190307 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d57cdcf0-5a72-44ff-9b9b-05de5b4974b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:25.208408 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d57cdcf0-5a72-44ff-9b9b-05de5b4974b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:25.216168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d57cdcf0-5a72-44ff-9b9b-05de5b4974b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:25.218172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5182b563-f3bc-4c0f-b22d-c2eb02a23b67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:25.219838 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d57cdcf0-5a72-44ff-9b9b-05de5b4974b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:25.221563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5182b563-f3bc-4c0f-b22d-c2eb02a23b67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:25.222607 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5182b563-f3bc-4c0f-b22d-c2eb02a23b67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:25.224777 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d57cdcf0-5a72-44ff-9b9b-05de5b4974b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:25.227560 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5182b563-f3bc-4c0f-b22d-c2eb02a23b67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:25.390515 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5182b563-f3bc-4c0f-b22d-c2eb02a23b67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.219262 Jan 28 01:02:25.395566 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 332/624] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:25 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:25.540116 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3bd38a19-21d8-4eba-b503-dc4668da9fee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:25.541365 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3bd38a19-21d8-4eba-b503-dc4668da9fee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:25.561170 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bd38a19-21d8-4eba-b503-dc4668da9fee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:25.561646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bd38a19-21d8-4eba-b503-dc4668da9fee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:25.562550 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bd38a19-21d8-4eba-b503-dc4668da9fee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:25.563354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bd38a19-21d8-4eba-b503-dc4668da9fee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:25.847532 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d57cdcf0-5a72-44ff-9b9b-05de5b4974b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:25.878935 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d57cdcf0-5a72-44ff-9b9b-05de5b4974b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.695391 Jan 28 01:02:25.880008 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 293/625] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:25 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:25.882862 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3bd38a19-21d8-4eba-b503-dc4668da9fee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:25.895902 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3bd38a19-21d8-4eba-b503-dc4668da9fee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1317 microversion: 2.1 time: 0.361201 Jan 28 01:02:25.896709 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 333/626] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:25 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:26.407298 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0d092515-6306-4226-af2a-d243748d0393 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:26.408847 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0d092515-6306-4226-af2a-d243748d0393 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:26.415620 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0d092515-6306-4226-af2a-d243748d0393 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:26.416509 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0d092515-6306-4226-af2a-d243748d0393 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:26.417568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0d092515-6306-4226-af2a-d243748d0393 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:26.418091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0d092515-6306-4226-af2a-d243748d0393 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:26.541499 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0d092515-6306-4226-af2a-d243748d0393 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.139157 Jan 28 01:02:26.542154 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 294/627] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:26 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:26.896377 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-67839acc-e5db-4bf7-93e7-7453586ab7b0 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:26.897734 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-67839acc-e5db-4bf7-93e7-7453586ab7b0 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:26.904989 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-67839acc-e5db-4bf7-93e7-7453586ab7b0 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:26.905805 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-67839acc-e5db-4bf7-93e7-7453586ab7b0 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:26.906723 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-67839acc-e5db-4bf7-93e7-7453586ab7b0 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:26.907443 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-67839acc-e5db-4bf7-93e7-7453586ab7b0 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:26.917889 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-09d3a222-5e94-4951-9e7e-05d6de71e67e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:26.920223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-09d3a222-5e94-4951-9e7e-05d6de71e67e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:26.929116 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-09d3a222-5e94-4951-9e7e-05d6de71e67e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:26.929875 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-09d3a222-5e94-4951-9e7e-05d6de71e67e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:26.931312 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-09d3a222-5e94-4951-9e7e-05d6de71e67e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:26.931996 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-09d3a222-5e94-4951-9e7e-05d6de71e67e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:27.070496 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-67839acc-e5db-4bf7-93e7-7453586ab7b0 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:27.080292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-67839acc-e5db-4bf7-93e7-7453586ab7b0 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.187490 Jan 28 01:02:27.081872 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 334/628] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:26 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:27.109718 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-09d3a222-5e94-4951-9e7e-05d6de71e67e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:27.122159 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-09d3a222-5e94-4951-9e7e-05d6de71e67e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1317 microversion: 2.1 time: 0.211767 Jan 28 01:02:27.123134 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 295/629] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:26 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:27.284651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-22f6fa6c-4cfd-4b31-be1a-bd4eaf7ad156 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Action: 'create', calling method: .version_select at 0x7f1a092d5550>, body: {"keypair": {"name": "tempest-TestShelveInstance-877278054"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:27.299516 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-22f6fa6c-4cfd-4b31-be1a-bd4eaf7ad156 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Getting quotas for project 5e156503ec1b459fbe5516b459e0c38b. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:27.304002 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-22f6fa6c-4cfd-4b31-be1a-bd4eaf7ad156 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Getting quotas for user 2d352592e91a48e38a6ecbb7293fd298 and project 5e156503ec1b459fbe5516b459e0c38b. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:27.499579 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-22f6fa6c-4cfd-4b31-be1a-bd4eaf7ad156 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Getting quotas for project 5e156503ec1b459fbe5516b459e0c38b. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:27.503916 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-22f6fa6c-4cfd-4b31-be1a-bd4eaf7ad156 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Getting quotas for user 2d352592e91a48e38a6ecbb7293fd298 and project 5e156503ec1b459fbe5516b459e0c38b. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:27.521680 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-22f6fa6c-4cfd-4b31-be1a-bd4eaf7ad156 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.438546 Jan 28 01:02:27.522441 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 335/630] 10.222.0.78 () {60 vars in 1157 bytes} [Fri Jan 28 01:02:27 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:27.553960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e3dc2da3-50fb-4674-b12b-9ed83fe78f56 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:27.555001 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e3dc2da3-50fb-4674-b12b-9ed83fe78f56 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:27.564316 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e3dc2da3-50fb-4674-b12b-9ed83fe78f56 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:27.564781 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e3dc2da3-50fb-4674-b12b-9ed83fe78f56 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:27.565599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e3dc2da3-50fb-4674-b12b-9ed83fe78f56 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:27.566060 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e3dc2da3-50fb-4674-b12b-9ed83fe78f56 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:27.686758 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e3dc2da3-50fb-4674-b12b-9ed83fe78f56 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.136711 Jan 28 01:02:27.687912 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 296/631] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:27 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:28.098368 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-23c48d0b-720d-45bf-95b8-23914efdf78c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:28.099100 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-23c48d0b-720d-45bf-95b8-23914efdf78c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:28.107031 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23c48d0b-720d-45bf-95b8-23914efdf78c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:28.107905 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23c48d0b-720d-45bf-95b8-23914efdf78c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:28.108984 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23c48d0b-720d-45bf-95b8-23914efdf78c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:28.109548 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-23c48d0b-720d-45bf-95b8-23914efdf78c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:28.144391 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-41b58615-52c0-4beb-9fb3-cd7a3ff3eb83 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:28.145704 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-41b58615-52c0-4beb-9fb3-cd7a3ff3eb83 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:28.153853 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-41b58615-52c0-4beb-9fb3-cd7a3ff3eb83 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:28.154504 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-41b58615-52c0-4beb-9fb3-cd7a3ff3eb83 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:28.155336 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-41b58615-52c0-4beb-9fb3-cd7a3ff3eb83 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:28.155996 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-41b58615-52c0-4beb-9fb3-cd7a3ff3eb83 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:28.325018 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-23c48d0b-720d-45bf-95b8-23914efdf78c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:28.333935 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-23c48d0b-720d-45bf-95b8-23914efdf78c tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.239983 Jan 28 01:02:28.345081 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 336/632] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:28 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:28.361544 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-41b58615-52c0-4beb-9fb3-cd7a3ff3eb83 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:28.369334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-41b58615-52c0-4beb-9fb3-cd7a3ff3eb83 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1317 microversion: 2.1 time: 0.231318 Jan 28 01:02:28.369928 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 297/633] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:28 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:28.701610 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2d4ac8e6-a464-44c3-9596-f27fd7419a79 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:28.701610 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2d4ac8e6-a464-44c3-9596-f27fd7419a79 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:28.712462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d4ac8e6-a464-44c3-9596-f27fd7419a79 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:28.712965 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d4ac8e6-a464-44c3-9596-f27fd7419a79 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:28.713774 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d4ac8e6-a464-44c3-9596-f27fd7419a79 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:28.714305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d4ac8e6-a464-44c3-9596-f27fd7419a79 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:28.821357 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2d4ac8e6-a464-44c3-9596-f27fd7419a79 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.126110 Jan 28 01:02:28.822072 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 337/634] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:28 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:29.351645 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f3b3e3ee-924e-476f-b7ef-b031fd5127a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:29.352823 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f3b3e3ee-924e-476f-b7ef-b031fd5127a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:29.359891 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b3e3ee-924e-476f-b7ef-b031fd5127a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:29.362013 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b3e3ee-924e-476f-b7ef-b031fd5127a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:29.362013 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b3e3ee-924e-476f-b7ef-b031fd5127a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:29.362013 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b3e3ee-924e-476f-b7ef-b031fd5127a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:29.386490 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-52778157-cc0e-497d-b292-09967feb27ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:29.388684 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-52778157-cc0e-497d-b292-09967feb27ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:29.396715 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-52778157-cc0e-497d-b292-09967feb27ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:29.397298 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-52778157-cc0e-497d-b292-09967feb27ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:29.398602 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-52778157-cc0e-497d-b292-09967feb27ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:29.399168 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-52778157-cc0e-497d-b292-09967feb27ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:29.557500 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f3b3e3ee-924e-476f-b7ef-b031fd5127a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:29.565921 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f3b3e3ee-924e-476f-b7ef-b031fd5127a3 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.217856 Jan 28 01:02:29.567299 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 298/635] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:29 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:29.576789 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-52778157-cc0e-497d-b292-09967feb27ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:29.577249 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-52778157-cc0e-497d-b292-09967feb27ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1317 microversion: 2.1 time: 0.195169 Jan 28 01:02:29.577899 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 338/636] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:29 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:29.750267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-9c35d365-1c65-49c6-856d-6c82ca3f666a req-9201b526-df56-4130-95f9-7ac485375df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31677564-4255-423a-b0c3-c971c15d7088", "name": "network-vif-plugged", "status": "completed", "tag": "7dc14b94-86ca-45c6-8d82-f843ddbc5a06"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:29.751852 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:29.751852 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:02:29.759488 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-9c35d365-1c65-49c6-856d-6c82ca3f666a req-9201b526-df56-4130-95f9-7ac485375df6 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:29.760150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-9c35d365-1c65-49c6-856d-6c82ca3f666a req-9201b526-df56-4130-95f9-7ac485375df6 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:29.778917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-9c35d365-1c65-49c6-856d-6c82ca3f666a req-9201b526-df56-4130-95f9-7ac485375df6 service nova] Creating event network-vif-plugged:7dc14b94-86ca-45c6-8d82-f843ddbc5a06 for instance 31677564-4255-423a-b0c3-c971c15d7088 on hv-cinder-81689 Jan 28 01:02:29.783960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-9c35d365-1c65-49c6-856d-6c82ca3f666a req-9201b526-df56-4130-95f9-7ac485375df6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037250 Jan 28 01:02:29.784627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 299/637] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:29.832305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7777b774-10df-4d55-9f83-4b2ea11025bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:29.833841 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7777b774-10df-4d55-9f83-4b2ea11025bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:29.841393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7777b774-10df-4d55-9f83-4b2ea11025bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:29.841854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7777b774-10df-4d55-9f83-4b2ea11025bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:29.842656 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7777b774-10df-4d55-9f83-4b2ea11025bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:29.843166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7777b774-10df-4d55-9f83-4b2ea11025bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:29.949713 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7777b774-10df-4d55-9f83-4b2ea11025bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.121025 Jan 28 01:02:29.950346 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 339/638] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:29 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:30.585204 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ddd2c0df-be0b-4893-b189-8e690eb276f9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:30.585902 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ddd2c0df-be0b-4893-b189-8e690eb276f9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:30.592958 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddd2c0df-be0b-4893-b189-8e690eb276f9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:30.593418 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddd2c0df-be0b-4893-b189-8e690eb276f9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:30.594212 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddd2c0df-be0b-4893-b189-8e690eb276f9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:30.594656 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ddd2c0df-be0b-4893-b189-8e690eb276f9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:30.594763 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a274684e-1c9f-4562-8536-4ebe2561c066 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:30.595603 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a274684e-1c9f-4562-8536-4ebe2561c066 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:30.606202 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a274684e-1c9f-4562-8536-4ebe2561c066 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:30.606652 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a274684e-1c9f-4562-8536-4ebe2561c066 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:30.607491 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a274684e-1c9f-4562-8536-4ebe2561c066 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:30.608126 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a274684e-1c9f-4562-8536-4ebe2561c066 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:30.771043 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ddd2c0df-be0b-4893-b189-8e690eb276f9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:30.781764 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ddd2c0df-be0b-4893-b189-8e690eb276f9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.200897 Jan 28 01:02:30.790530 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a274684e-1c9f-4562-8536-4ebe2561c066 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:30.792266 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 300/639] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:30 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:30.798803 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a274684e-1c9f-4562-8536-4ebe2561c066 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1317 microversion: 2.1 time: 0.208063 Jan 28 01:02:30.799399 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 340/640] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:30 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:30.961737 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a8c4dca2-f436-4967-83f5-5ce480fa5de1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:30.963718 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a8c4dca2-f436-4967-83f5-5ce480fa5de1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:30.970673 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8c4dca2-f436-4967-83f5-5ce480fa5de1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:30.971887 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8c4dca2-f436-4967-83f5-5ce480fa5de1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:30.973520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8c4dca2-f436-4967-83f5-5ce480fa5de1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:30.974036 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a8c4dca2-f436-4967-83f5-5ce480fa5de1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:31.089911 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a8c4dca2-f436-4967-83f5-5ce480fa5de1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.132392 Jan 28 01:02:31.090558 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 301/641] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:30 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:31.799681 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8b037ea2-cee7-4d34-b457-a3cf32452d19 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:31.800306 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8b037ea2-cee7-4d34-b457-a3cf32452d19 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:31.807299 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b037ea2-cee7-4d34-b457-a3cf32452d19 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:31.807760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b037ea2-cee7-4d34-b457-a3cf32452d19 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:31.808553 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b037ea2-cee7-4d34-b457-a3cf32452d19 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:31.808998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b037ea2-cee7-4d34-b457-a3cf32452d19 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:31.817330 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8c378c81-5769-4fa4-942a-bdfd02a5e39d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:31.818133 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8c378c81-5769-4fa4-942a-bdfd02a5e39d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:31.825258 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8c378c81-5769-4fa4-942a-bdfd02a5e39d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:31.825833 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8c378c81-5769-4fa4-942a-bdfd02a5e39d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:31.826729 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8c378c81-5769-4fa4-942a-bdfd02a5e39d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:31.827279 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8c378c81-5769-4fa4-942a-bdfd02a5e39d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:31.975765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8c378c81-5769-4fa4-942a-bdfd02a5e39d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:31.981102 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8b037ea2-cee7-4d34-b457-a3cf32452d19 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:31.984210 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8c378c81-5769-4fa4-942a-bdfd02a5e39d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1506 microversion: 2.1 time: 0.170510 Jan 28 01:02:31.984816 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 302/642] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:31 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:31.989562 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8b037ea2-cee7-4d34-b457-a3cf32452d19 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.193648 Jan 28 01:02:31.990219 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 341/643] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:31 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:32.101053 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-06056ca8-553e-43ce-a2f4-9573320a3fdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:32.102459 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-06056ca8-553e-43ce-a2f4-9573320a3fdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:32.111633 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-06056ca8-553e-43ce-a2f4-9573320a3fdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:32.112111 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-06056ca8-553e-43ce-a2f4-9573320a3fdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:32.112913 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-06056ca8-553e-43ce-a2f4-9573320a3fdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:32.113372 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-06056ca8-553e-43ce-a2f4-9573320a3fdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:32.222463 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-06056ca8-553e-43ce-a2f4-9573320a3fdc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.125590 Jan 28 01:02:32.223146 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 303/644] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:32 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:33.007540 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-48e6b15e-75fe-4638-a8ef-efb0ad3bc985 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:33.008147 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-48e6b15e-75fe-4638-a8ef-efb0ad3bc985 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:33.014369 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-48e6b15e-75fe-4638-a8ef-efb0ad3bc985 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:33.014814 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-48e6b15e-75fe-4638-a8ef-efb0ad3bc985 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:33.015624 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-48e6b15e-75fe-4638-a8ef-efb0ad3bc985 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:33.016083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-48e6b15e-75fe-4638-a8ef-efb0ad3bc985 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:33.164726 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-48e6b15e-75fe-4638-a8ef-efb0ad3bc985 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:33.174536 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-48e6b15e-75fe-4638-a8ef-efb0ad3bc985 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.170591 Jan 28 01:02:33.175187 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 342/645] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:33 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:33.234690 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8d822a53-089f-4d99-b985-cdab6b3892ab tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:33.235714 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8d822a53-089f-4d99-b985-cdab6b3892ab tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:33.243032 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d822a53-089f-4d99-b985-cdab6b3892ab tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:33.243419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d822a53-089f-4d99-b985-cdab6b3892ab tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:33.244395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d822a53-089f-4d99-b985-cdab6b3892ab tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:33.244819 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d822a53-089f-4d99-b985-cdab6b3892ab tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:33.342150 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-29f08541-39d6-4c16-8cb9-285248b25534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83f888bb-1590-46c5-a3bf-30d966a9813f"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:33.346277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-29f08541-39d6-4c16-8cb9-285248b25534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:33.353364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-29f08541-39d6-4c16-8cb9-285248b25534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:33.354379 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-29f08541-39d6-4c16-8cb9-285248b25534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:33.355943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-29f08541-39d6-4c16-8cb9-285248b25534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:33.356855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-29f08541-39d6-4c16-8cb9-285248b25534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:33.373631 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8d822a53-089f-4d99-b985-cdab6b3892ab tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 14 microversion: 2.20 time: 0.142819 Jan 28 01:02:33.374272 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 304/646] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:33 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:33.658297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-29f08541-39d6-4c16-8cb9-285248b25534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "POST /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319785 Jan 28 01:02:33.664242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 343/647] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:02:33 2022] POST /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:34.191658 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-717fabbd-c9fe-4081-9da3-338a4b4b209a tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:34.192371 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-717fabbd-c9fe-4081-9da3-338a4b4b209a tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:34.199773 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-717fabbd-c9fe-4081-9da3-338a4b4b209a tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:34.200228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-717fabbd-c9fe-4081-9da3-338a4b4b209a tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:34.201010 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-717fabbd-c9fe-4081-9da3-338a4b4b209a tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:34.201450 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-717fabbd-c9fe-4081-9da3-338a4b4b209a tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:34.343286 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-717fabbd-c9fe-4081-9da3-338a4b4b209a tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:34.351329 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-717fabbd-c9fe-4081-9da3-338a4b4b209a tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.163597 Jan 28 01:02:34.351900 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 305/648] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:34 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:34.386141 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7f76a343-b62a-401a-a084-f2b39b3d2677 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:34.387242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7f76a343-b62a-401a-a084-f2b39b3d2677 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:34.393381 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7f76a343-b62a-401a-a084-f2b39b3d2677 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:34.393839 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7f76a343-b62a-401a-a084-f2b39b3d2677 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:34.394628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7f76a343-b62a-401a-a084-f2b39b3d2677 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:34.395109 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7f76a343-b62a-401a-a084-f2b39b3d2677 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:34.520714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7f76a343-b62a-401a-a084-f2b39b3d2677 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 6740 microversion: 2.20 time: 0.139796 Jan 28 01:02:34.521341 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 344/649] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:34 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 6740 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:02:35.368654 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2b7fc331-3b66-4a62-a5e0-71f289a28d7b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:35.369834 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2b7fc331-3b66-4a62-a5e0-71f289a28d7b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:35.376632 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2b7fc331-3b66-4a62-a5e0-71f289a28d7b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:35.377163 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2b7fc331-3b66-4a62-a5e0-71f289a28d7b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:35.378148 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2b7fc331-3b66-4a62-a5e0-71f289a28d7b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:35.378597 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2b7fc331-3b66-4a62-a5e0-71f289a28d7b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:35.528584 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2b7fc331-3b66-4a62-a5e0-71f289a28d7b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:35.533195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2fd7439a-d08f-40aa-8e4e-dab900ba7b2a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:35.534216 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2fd7439a-d08f-40aa-8e4e-dab900ba7b2a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:35.537467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2b7fc331-3b66-4a62-a5e0-71f289a28d7b tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.172383 Jan 28 01:02:35.538052 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 306/650] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:35 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:35.540602 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2fd7439a-d08f-40aa-8e4e-dab900ba7b2a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:35.541612 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2fd7439a-d08f-40aa-8e4e-dab900ba7b2a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:35.542413 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2fd7439a-d08f-40aa-8e4e-dab900ba7b2a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:35.542858 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2fd7439a-d08f-40aa-8e4e-dab900ba7b2a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:35.675756 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2fd7439a-d08f-40aa-8e4e-dab900ba7b2a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 12578 microversion: 2.20 time: 0.146783 Jan 28 01:02:35.676608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 345/651] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:35 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 12578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:02:36.554921 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-223c0863-771d-4b63-8759-217f4c3e23fe tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:36.555535 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-223c0863-771d-4b63-8759-217f4c3e23fe tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:36.562023 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223c0863-771d-4b63-8759-217f4c3e23fe tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:36.562545 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223c0863-771d-4b63-8759-217f4c3e23fe tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:36.563361 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223c0863-771d-4b63-8759-217f4c3e23fe tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:36.563974 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-223c0863-771d-4b63-8759-217f4c3e23fe tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:36.687945 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2cfca2e3-ceb5-469f-87ce-463310d20551 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:36.689671 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2cfca2e3-ceb5-469f-87ce-463310d20551 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:36.696716 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2cfca2e3-ceb5-469f-87ce-463310d20551 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:36.697725 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2cfca2e3-ceb5-469f-87ce-463310d20551 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:36.698534 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2cfca2e3-ceb5-469f-87ce-463310d20551 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:36.699078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2cfca2e3-ceb5-469f-87ce-463310d20551 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:36.714543 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-223c0863-771d-4b63-8759-217f4c3e23fe tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:36.722483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-223c0863-771d-4b63-8759-217f4c3e23fe tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.171033 Jan 28 01:02:36.723085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 307/652] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:36 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:36.823529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2cfca2e3-ceb5-469f-87ce-463310d20551 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 16235 microversion: 2.20 time: 0.139540 Jan 28 01:02:36.824181 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 346/653] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:36 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 16235 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:37.743862 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9c577ca6-73fd-4d9e-868b-808dd6146452 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:37.744641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9c577ca6-73fd-4d9e-868b-808dd6146452 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:37.751154 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c577ca6-73fd-4d9e-868b-808dd6146452 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:37.751614 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c577ca6-73fd-4d9e-868b-808dd6146452 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:37.752422 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c577ca6-73fd-4d9e-868b-808dd6146452 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:37.752864 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c577ca6-73fd-4d9e-868b-808dd6146452 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:37.835908 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-dc5e27ab-ec99-4216-8519-f28e54cc355c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:37.837156 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-dc5e27ab-ec99-4216-8519-f28e54cc355c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:37.844776 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dc5e27ab-ec99-4216-8519-f28e54cc355c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:37.845226 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dc5e27ab-ec99-4216-8519-f28e54cc355c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:37.846021 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dc5e27ab-ec99-4216-8519-f28e54cc355c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:37.846490 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dc5e27ab-ec99-4216-8519-f28e54cc355c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:37.900592 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-9c577ca6-73fd-4d9e-868b-808dd6146452 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:37.909066 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9c577ca6-73fd-4d9e-868b-808dd6146452 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.169643 Jan 28 01:02:37.909733 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 308/654] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:37 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:37.995918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-dc5e27ab-ec99-4216-8519-f28e54cc355c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 17960 microversion: 2.20 time: 0.163786 Jan 28 01:02:37.996480 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 347/655] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:37 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 17960 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:38.926154 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4651e734-1e96-49a7-8119-f5477e9686f1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:38.926765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4651e734-1e96-49a7-8119-f5477e9686f1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:38.933735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4651e734-1e96-49a7-8119-f5477e9686f1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:38.934180 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4651e734-1e96-49a7-8119-f5477e9686f1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:38.935000 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4651e734-1e96-49a7-8119-f5477e9686f1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:38.935437 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4651e734-1e96-49a7-8119-f5477e9686f1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:39.008569 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-43eebbc6-2285-49b2-ae0b-7689b11d4620 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:39.010077 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-43eebbc6-2285-49b2-ae0b-7689b11d4620 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:39.016851 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-43eebbc6-2285-49b2-ae0b-7689b11d4620 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:39.017311 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-43eebbc6-2285-49b2-ae0b-7689b11d4620 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:39.018099 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-43eebbc6-2285-49b2-ae0b-7689b11d4620 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:39.018539 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-43eebbc6-2285-49b2-ae0b-7689b11d4620 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:39.179112 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4651e734-1e96-49a7-8119-f5477e9686f1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:39.187816 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4651e734-1e96-49a7-8119-f5477e9686f1 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1757 microversion: 2.1 time: 0.265198 Jan 28 01:02:39.188867 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 309/656] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:38 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1757 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:39.194518 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-43eebbc6-2285-49b2-ae0b-7689b11d4620 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 19342 microversion: 2.20 time: 0.189917 Jan 28 01:02:39.195257 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 348/657] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:39 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 19342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:02:40.206708 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-50f10542-3cb2-4bfc-a551-d250648a69ef tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:40.207476 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-50f10542-3cb2-4bfc-a551-d250648a69ef tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:40.207966 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-59456e36-818a-498e-8024-a3dc3b294b6e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:40.209222 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-59456e36-818a-498e-8024-a3dc3b294b6e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:40.214690 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-50f10542-3cb2-4bfc-a551-d250648a69ef tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:40.215188 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-50f10542-3cb2-4bfc-a551-d250648a69ef tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.216137 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-50f10542-3cb2-4bfc-a551-d250648a69ef tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:40.216614 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-50f10542-3cb2-4bfc-a551-d250648a69ef tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.216718 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59456e36-818a-498e-8024-a3dc3b294b6e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:40.217108 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59456e36-818a-498e-8024-a3dc3b294b6e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.217941 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59456e36-818a-498e-8024-a3dc3b294b6e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:40.218367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59456e36-818a-498e-8024-a3dc3b294b6e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.379548 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-50f10542-3cb2-4bfc-a551-d250648a69ef tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:40.391630 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-50f10542-3cb2-4bfc-a551-d250648a69ef tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1760 microversion: 2.1 time: 0.188326 Jan 28 01:02:40.391872 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-59456e36-818a-498e-8024-a3dc3b294b6e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 20996 microversion: 2.20 time: 0.188287 Jan 28 01:02:40.392907 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 310/658] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:40 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1760 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:40.403394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 349/659] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:40 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 20996 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:02:41.148597 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-99abf4ad-eef6-4606-b36b-d448fd96b75f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83f888bb-1590-46c5-a3bf-30d966a9813f"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:41.150030 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-99abf4ad-eef6-4606-b36b-d448fd96b75f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:41.156153 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99abf4ad-eef6-4606-b36b-d448fd96b75f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.156632 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99abf4ad-eef6-4606-b36b-d448fd96b75f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.157434 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99abf4ad-eef6-4606-b36b-d448fd96b75f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.157872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99abf4ad-eef6-4606-b36b-d448fd96b75f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.251135 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-99abf4ad-eef6-4606-b36b-d448fd96b75f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] HTTP exception thrown: Invalid volume: volume 83f888bb-1590-46c5-a3bf-30d966a9813f is already attached to instances: 31677564-4255-423a-b0c3-c971c15d7088 Jan 28 01:02:41.251852 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-99abf4ad-eef6-4606-b36b-d448fd96b75f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Returning 400 to user: Invalid volume: volume 83f888bb-1590-46c5-a3bf-30d966a9813f is already attached to instances: 31677564-4255-423a-b0c3-c971c15d7088 {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:02:41.252766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-99abf4ad-eef6-4606-b36b-d448fd96b75f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "POST /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108068 Jan 28 01:02:41.253344 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 311/660] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:02:41 2022] POST /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 01:02:41.322378 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3df06f61-24f1-4732-8427-abab486e7f48 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:41.323515 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3df06f61-24f1-4732-8427-abab486e7f48 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:41.334873 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3df06f61-24f1-4732-8427-abab486e7f48 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.335405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3df06f61-24f1-4732-8427-abab486e7f48 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.336752 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3df06f61-24f1-4732-8427-abab486e7f48 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.337449 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3df06f61-24f1-4732-8427-abab486e7f48 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.404636 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-69fa2ca0-aff8-457b-8ecb-e3a8b6f4405b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:41.405664 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-69fa2ca0-aff8-457b-8ecb-e3a8b6f4405b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:41.411843 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-69fa2ca0-aff8-457b-8ecb-e3a8b6f4405b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.412322 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-69fa2ca0-aff8-457b-8ecb-e3a8b6f4405b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.413122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-69fa2ca0-aff8-457b-8ecb-e3a8b6f4405b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.413572 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-69fa2ca0-aff8-457b-8ecb-e3a8b6f4405b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.544157 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-3df06f61-24f1-4732-8427-abab486e7f48 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lazy-loading 'services' on Instance uuid 31677564-4255-423a-b0c3-c971c15d7088 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:02:41.555756 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-69fa2ca0-aff8-457b-8ecb-e3a8b6f4405b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 22493 microversion: 2.20 time: 0.155463 Jan 28 01:02:41.556410 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 312/661] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:41 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 22493 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:02:41.622171 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3df06f61-24f1-4732-8427-abab486e7f48 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments/83f888bb-1590-46c5-a3bf-30d966a9813f" status: 202 len: 0 microversion: 2.1 time: 0.306360 Jan 28 01:02:41.623050 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 350/662] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:02:41 2022] DELETE /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments/83f888bb-1590-46c5-a3bf-30d966a9813f => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:41.631687 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b3e4ee17-e687-4284-aff6-06bb0cbe4f36 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:41.632721 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b3e4ee17-e687-4284-aff6-06bb0cbe4f36 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:41.640066 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b3e4ee17-e687-4284-aff6-06bb0cbe4f36 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.640539 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b3e4ee17-e687-4284-aff6-06bb0cbe4f36 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.641361 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b3e4ee17-e687-4284-aff6-06bb0cbe4f36 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.641811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b3e4ee17-e687-4284-aff6-06bb0cbe4f36 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.681558 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b3e4ee17-e687-4284-aff6-06bb0cbe4f36 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053797 Jan 28 01:02:41.682233 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 313/663] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:02:41 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:42.573350 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-31e15639-aa3b-46ff-bc79-2c679ba55584 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:42.575035 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-31e15639-aa3b-46ff-bc79-2c679ba55584 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:42.583849 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-31e15639-aa3b-46ff-bc79-2c679ba55584 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:42.584306 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-31e15639-aa3b-46ff-bc79-2c679ba55584 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:42.585106 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-31e15639-aa3b-46ff-bc79-2c679ba55584 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:42.585538 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-31e15639-aa3b-46ff-bc79-2c679ba55584 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:42.695557 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2c1629a1-0893-4c7c-bd32-f8fd712b4754 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:42.696409 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2c1629a1-0893-4c7c-bd32-f8fd712b4754 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:42.703239 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2c1629a1-0893-4c7c-bd32-f8fd712b4754 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:42.703691 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2c1629a1-0893-4c7c-bd32-f8fd712b4754 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:42.704510 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2c1629a1-0893-4c7c-bd32-f8fd712b4754 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:42.704952 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2c1629a1-0893-4c7c-bd32-f8fd712b4754 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:42.735326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-31e15639-aa3b-46ff-bc79-2c679ba55584 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 23503 microversion: 2.20 time: 0.168774 Jan 28 01:02:42.736382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 351/664] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:42 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 23503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:42.747917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2c1629a1-0893-4c7c-bd32-f8fd712b4754 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056651 Jan 28 01:02:42.748510 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 314/665] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:02:42 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:43.748285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-954790fa-b4ae-422d-b1d5-21fdb97a279b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:43.749319 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-954790fa-b4ae-422d-b1d5-21fdb97a279b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:43.756166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-954790fa-b4ae-422d-b1d5-21fdb97a279b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:43.756615 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-954790fa-b4ae-422d-b1d5-21fdb97a279b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:43.757388 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-954790fa-b4ae-422d-b1d5-21fdb97a279b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:43.757817 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-954790fa-b4ae-422d-b1d5-21fdb97a279b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:43.760688 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ad5dcd95-f514-4603-8418-9110cc629392 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:43.761735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ad5dcd95-f514-4603-8418-9110cc629392 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:43.767864 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ad5dcd95-f514-4603-8418-9110cc629392 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:43.768317 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ad5dcd95-f514-4603-8418-9110cc629392 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:43.769104 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ad5dcd95-f514-4603-8418-9110cc629392 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:43.769541 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ad5dcd95-f514-4603-8418-9110cc629392 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:43.803121 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ad5dcd95-f514-4603-8418-9110cc629392 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046090 Jan 28 01:02:43.803698 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 315/666] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:02:43 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:02:43.872458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-954790fa-b4ae-422d-b1d5-21fdb97a279b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 24417 microversion: 2.20 time: 0.128035 Jan 28 01:02:43.877083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 352/667] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:43 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 24417 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:43.959175 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1095285776", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "networks": [{"uuid": "8d64b8b0-7739-4455-9d0c-091754eae844"}]}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:44.013512 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] validate_networks() for [('8d64b8b0-7739-4455-9d0c-091754eae844', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:02:44.433823 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:02:44.434250 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:02:44.434722 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:02:44.435188 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:02:44.435629 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:02:44.444291 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:44.445203 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:44.446028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:44.446472 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:44.463212 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Getting quotas for project 433c6f07b086479f94f16f5314942da7. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:44.467097 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Getting quotas for user 957a7c1ed6e045fdb3252969ea163b24 and project 433c6f07b086479f94f16f5314942da7. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:44.477740 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:02:44.480082 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:02:44.525674 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-97fd94b0-cdb4-4d35-95dd-0ef3cd28194d tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569399 Jan 28 01:02:44.526250 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 316/668] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:02:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:02:44.536379 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1e9880f1-29bb-453f-b57d-aa1b8515d6f6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:44.537083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1e9880f1-29bb-453f-b57d-aa1b8515d6f6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:44.590760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1e9880f1-29bb-453f-b57d-aa1b8515d6f6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:44.597761 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1e9880f1-29bb-453f-b57d-aa1b8515d6f6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1218 microversion: 2.1 time: 0.065297 Jan 28 01:02:44.598457 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 353/669] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:44 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:44.886252 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5d10f141-6173-40a6-a682-9997db7967c1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:44.887458 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5d10f141-6173-40a6-a682-9997db7967c1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:44.895679 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5d10f141-6173-40a6-a682-9997db7967c1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:44.896222 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5d10f141-6173-40a6-a682-9997db7967c1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:44.897086 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5d10f141-6173-40a6-a682-9997db7967c1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:44.897685 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5d10f141-6173-40a6-a682-9997db7967c1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:45.072606 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5d10f141-6173-40a6-a682-9997db7967c1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 25273 microversion: 2.20 time: 0.190859 Jan 28 01:02:45.073192 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 317/670] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:44 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 25273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:02:45.615825 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6eb78386-bcfc-4b4b-b1cd-8e93d87bfabd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:45.616497 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6eb78386-bcfc-4b4b-b1cd-8e93d87bfabd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:45.624681 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6eb78386-bcfc-4b4b-b1cd-8e93d87bfabd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:45.625163 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6eb78386-bcfc-4b4b-b1cd-8e93d87bfabd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:45.625952 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6eb78386-bcfc-4b4b-b1cd-8e93d87bfabd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:45.626391 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6eb78386-bcfc-4b4b-b1cd-8e93d87bfabd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:45.694121 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6eb78386-bcfc-4b4b-b1cd-8e93d87bfabd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:45.701499 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6eb78386-bcfc-4b4b-b1cd-8e93d87bfabd tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1270 microversion: 2.1 time: 0.090337 Jan 28 01:02:45.702067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 354/671] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:45 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:46.084965 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-71f27997-eac1-4460-9c63-ebc935552534 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:46.086174 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-71f27997-eac1-4460-9c63-ebc935552534 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:46.093241 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-71f27997-eac1-4460-9c63-ebc935552534 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:46.093698 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-71f27997-eac1-4460-9c63-ebc935552534 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:46.094490 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-71f27997-eac1-4460-9c63-ebc935552534 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:46.094973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-71f27997-eac1-4460-9c63-ebc935552534 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:46.244321 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-71f27997-eac1-4460-9c63-ebc935552534 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 26080 microversion: 2.20 time: 0.163576 Jan 28 01:02:46.248076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 318/672] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:46 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 26080 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:46.718101 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-07eb2c07-5fc9-4ef8-8b3b-06bff9ab58af tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:46.719099 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-07eb2c07-5fc9-4ef8-8b3b-06bff9ab58af tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:46.725304 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-07eb2c07-5fc9-4ef8-8b3b-06bff9ab58af tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:46.725765 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-07eb2c07-5fc9-4ef8-8b3b-06bff9ab58af tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:46.726559 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-07eb2c07-5fc9-4ef8-8b3b-06bff9ab58af tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:46.727027 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-07eb2c07-5fc9-4ef8-8b3b-06bff9ab58af tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:46.999064 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-07eb2c07-5fc9-4ef8-8b3b-06bff9ab58af tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:47.006146 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-07eb2c07-5fc9-4ef8-8b3b-06bff9ab58af tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1318 microversion: 2.1 time: 0.291696 Jan 28 01:02:47.006721 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 355/673] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:46 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:47.256138 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-93aeb240-bc8b-4849-b1d8-5f96007291a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:47.257183 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-93aeb240-bc8b-4849-b1d8-5f96007291a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:47.264841 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93aeb240-bc8b-4849-b1d8-5f96007291a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:47.265298 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93aeb240-bc8b-4849-b1d8-5f96007291a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:47.266103 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93aeb240-bc8b-4849-b1d8-5f96007291a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:47.266609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93aeb240-bc8b-4849-b1d8-5f96007291a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:47.342867 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-408ca5f3-18c9-45c9-b911-cd4fa9350411 req-9a521846-cb55-426d-984c-58af53286186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f18b7d-3661-4a95-9adc-6b3086996175", "tag": "5675595b-a397-4283-a05e-85b239e3bbc1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:47.344481 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:47.344481 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:02:47.352265 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-408ca5f3-18c9-45c9-b911-cd4fa9350411 req-9a521846-cb55-426d-984c-58af53286186 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:47.352710 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-408ca5f3-18c9-45c9-b911-cd4fa9350411 req-9a521846-cb55-426d-984c-58af53286186 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:47.367549 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-408ca5f3-18c9-45c9-b911-cd4fa9350411 req-9a521846-cb55-426d-984c-58af53286186 service nova] Creating event network-changed:5675595b-a397-4283-a05e-85b239e3bbc1 for instance 49f18b7d-3661-4a95-9adc-6b3086996175 on hv-cinder-81689 Jan 28 01:02:47.372326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-408ca5f3-18c9-45c9-b911-cd4fa9350411 req-9a521846-cb55-426d-984c-58af53286186 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033105 Jan 28 01:02:47.372919 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 356/674] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:47.407837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-93aeb240-bc8b-4849-b1d8-5f96007291a0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 26736 microversion: 2.20 time: 0.155672 Jan 28 01:02:47.408400 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 319/675] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:47 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 26736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:48.023793 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2048ae01-3657-413c-a902-8812d3d584c6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:48.024451 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2048ae01-3657-413c-a902-8812d3d584c6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:48.031879 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2048ae01-3657-413c-a902-8812d3d584c6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:48.032337 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2048ae01-3657-413c-a902-8812d3d584c6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:48.033127 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2048ae01-3657-413c-a902-8812d3d584c6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:48.033568 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2048ae01-3657-413c-a902-8812d3d584c6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:48.254257 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2048ae01-3657-413c-a902-8812d3d584c6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:48.262266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2048ae01-3657-413c-a902-8812d3d584c6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1318 microversion: 2.1 time: 0.242933 Jan 28 01:02:48.262842 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 357/676] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:48 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:48.420715 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-34ff7a8b-ced1-401f-aa6e-f7febd7acf3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:48.422122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-34ff7a8b-ced1-401f-aa6e-f7febd7acf3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:48.429398 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34ff7a8b-ced1-401f-aa6e-f7febd7acf3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:48.429935 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34ff7a8b-ced1-401f-aa6e-f7febd7acf3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:48.430809 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34ff7a8b-ced1-401f-aa6e-f7febd7acf3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:48.431543 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34ff7a8b-ced1-401f-aa6e-f7febd7acf3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:48.547053 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-34ff7a8b-ced1-401f-aa6e-f7febd7acf3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 27222 microversion: 2.20 time: 0.130929 Jan 28 01:02:48.547897 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 320/677] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:48 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 27222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:49.179052 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2126557978", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-877278054", "security_groups": [{"name": "tempest-secgroup-smoke-1296656208"}], "networks": [{"uuid": "86bf1e59-906d-4d2f-bc1b-2c7309e2352c"}], "block_device_mapping_v2": [{"uuid": "806f3150-b8b6-4e47-ba65-8295934a1d33", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:49.284357 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-eb218b7b-1121-4142-8566-bc8cf0d094f9 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:49.285254 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-eb218b7b-1121-4142-8566-bc8cf0d094f9 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:49.292993 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] validate_networks() for [('86bf1e59-906d-4d2f-bc1b-2c7309e2352c', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:02:49.293415 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-eb218b7b-1121-4142-8566-bc8cf0d094f9 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:49.293878 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-eb218b7b-1121-4142-8566-bc8cf0d094f9 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:49.294682 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-eb218b7b-1121-4142-8566-bc8cf0d094f9 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:49.295166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-eb218b7b-1121-4142-8566-bc8cf0d094f9 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:49.437890 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-eb218b7b-1121-4142-8566-bc8cf0d094f9 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:49.445961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-eb218b7b-1121-4142-8566-bc8cf0d094f9 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1318 microversion: 2.1 time: 0.168782 Jan 28 01:02:49.454957 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 321/678] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:49 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:49.558235 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d21d49be-1f4c-437b-808e-c92a32c0a898 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:49.559238 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d21d49be-1f4c-437b-808e-c92a32c0a898 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:49.565965 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d21d49be-1f4c-437b-808e-c92a32c0a898 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:49.566507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d21d49be-1f4c-437b-808e-c92a32c0a898 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:49.567309 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d21d49be-1f4c-437b-808e-c92a32c0a898 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:49.567748 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d21d49be-1f4c-437b-808e-c92a32c0a898 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:49.673330 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d21d49be-1f4c-437b-808e-c92a32c0a898 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 27683 microversion: 2.20 time: 0.118456 Jan 28 01:02:49.675355 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 322/679] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:49 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 27683 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:49.677947 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:02:49.678375 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:02:49.678848 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:02:49.679514 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:02:49.679730 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:02:49.689789 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:49.690370 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:49.691302 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:49.691748 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:49.711684 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Getting quotas for project 5e156503ec1b459fbe5516b459e0c38b. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:49.716021 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Getting quotas for user 2d352592e91a48e38a6ecbb7293fd298 and project 5e156503ec1b459fbe5516b459e0c38b. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:49.776454 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:02:49.778664 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='806f3150-b8b6-4e47-ba65-8295934a1d33',volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:02:49.912161 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-bf4792f6-0b9f-466a-bb5b-92bcd570fcf2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.735323 Jan 28 01:02:49.912161 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 358/680] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:02:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:02:49.922014 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-97164ae6-5901-4e78-8ada-d9dca0383252 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:49.922656 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-97164ae6-5901-4e78-8ada-d9dca0383252 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:49.985003 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-97164ae6-5901-4e78-8ada-d9dca0383252 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:49.991809 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-97164ae6-5901-4e78-8ada-d9dca0383252 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1088 microversion: 2.1 time: 0.073895 Jan 28 01:02:50.001910 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 323/681] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:49 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:50.464498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9873da0b-41c0-4048-8f57-47d5da09d99f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:50.465110 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9873da0b-41c0-4048-8f57-47d5da09d99f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:50.471589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9873da0b-41c0-4048-8f57-47d5da09d99f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:50.472045 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9873da0b-41c0-4048-8f57-47d5da09d99f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:50.472824 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9873da0b-41c0-4048-8f57-47d5da09d99f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:50.473259 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9873da0b-41c0-4048-8f57-47d5da09d99f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:50.627492 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9873da0b-41c0-4048-8f57-47d5da09d99f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:50.635438 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9873da0b-41c0-4048-8f57-47d5da09d99f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1318 microversion: 2.1 time: 0.175607 Jan 28 01:02:50.636009 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 359/682] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:50 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:50.686187 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ec16f62b-bab4-4cb2-b7ac-d3f8c1419d13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:50.687141 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ec16f62b-bab4-4cb2-b7ac-d3f8c1419d13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:50.693604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ec16f62b-bab4-4cb2-b7ac-d3f8c1419d13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:50.694052 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ec16f62b-bab4-4cb2-b7ac-d3f8c1419d13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:50.694839 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ec16f62b-bab4-4cb2-b7ac-d3f8c1419d13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:50.695302 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ec16f62b-bab4-4cb2-b7ac-d3f8c1419d13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:50.805288 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ec16f62b-bab4-4cb2-b7ac-d3f8c1419d13 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 27917 microversion: 2.20 time: 0.122584 Jan 28 01:02:50.805843 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 324/683] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:50 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 27917 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:51.008147 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-45611f46-7d84-4781-92a8-bc6582b250ad tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:51.008765 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-45611f46-7d84-4781-92a8-bc6582b250ad tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:51.015175 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-45611f46-7d84-4781-92a8-bc6582b250ad tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:51.015636 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-45611f46-7d84-4781-92a8-bc6582b250ad tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:51.016448 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-45611f46-7d84-4781-92a8-bc6582b250ad tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:51.016869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-45611f46-7d84-4781-92a8-bc6582b250ad tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:51.074419 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-45611f46-7d84-4781-92a8-bc6582b250ad tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:51.081696 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-45611f46-7d84-4781-92a8-bc6582b250ad tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1186 microversion: 2.1 time: 0.077171 Jan 28 01:02:51.082271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 360/684] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:51 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1186 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:51.653591 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8bd69210-e5c0-4f30-b6b6-426aa6333196 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:51.654406 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8bd69210-e5c0-4f30-b6b6-426aa6333196 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:51.661371 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8bd69210-e5c0-4f30-b6b6-426aa6333196 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:51.661759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8bd69210-e5c0-4f30-b6b6-426aa6333196 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:51.662549 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8bd69210-e5c0-4f30-b6b6-426aa6333196 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:51.663011 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8bd69210-e5c0-4f30-b6b6-426aa6333196 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:51.815519 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8bd69210-e5c0-4f30-b6b6-426aa6333196 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:51.817168 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-581e141c-171c-48aa-96c1-3e16dfb9ed24 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:51.818674 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-581e141c-171c-48aa-96c1-3e16dfb9ed24 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:51.824251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8bd69210-e5c0-4f30-b6b6-426aa6333196 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1318 microversion: 2.1 time: 0.175475 Jan 28 01:02:51.825857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-581e141c-171c-48aa-96c1-3e16dfb9ed24 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:51.826488 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-581e141c-171c-48aa-96c1-3e16dfb9ed24 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:51.827469 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-581e141c-171c-48aa-96c1-3e16dfb9ed24 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:51.828247 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-581e141c-171c-48aa-96c1-3e16dfb9ed24 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:51.834765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 325/685] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:51 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:51.882763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-8e036f21-c112-4781-be54-60bec97eb995 req-8496a928-5633-4b82-9906-c4c9d1073e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f18b7d-3661-4a95-9adc-6b3086996175", "name": "network-vif-plugged", "status": "completed", "tag": "5675595b-a397-4283-a05e-85b239e3bbc1"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:51.885645 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:51.885645 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:02:51.893885 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-8e036f21-c112-4781-be54-60bec97eb995 req-8496a928-5633-4b82-9906-c4c9d1073e39 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:51.894463 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-8e036f21-c112-4781-be54-60bec97eb995 req-8496a928-5633-4b82-9906-c4c9d1073e39 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:51.907053 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-8e036f21-c112-4781-be54-60bec97eb995 req-8496a928-5633-4b82-9906-c4c9d1073e39 service nova] Creating event network-vif-plugged:5675595b-a397-4283-a05e-85b239e3bbc1 for instance 49f18b7d-3661-4a95-9adc-6b3086996175 on hv-cinder-81689 Jan 28 01:02:51.913068 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-8e036f21-c112-4781-be54-60bec97eb995 req-8496a928-5633-4b82-9906-c4c9d1073e39 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034444 Jan 28 01:02:51.914215 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 326/686] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:52.007013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-581e141c-171c-48aa-96c1-3e16dfb9ed24 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28212 microversion: 2.20 time: 0.193749 Jan 28 01:02:52.007664 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 361/687] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:51 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28212 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:52.101141 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-41ccfa53-c674-4e4a-985d-0d777e32dd10 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:52.102197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-41ccfa53-c674-4e4a-985d-0d777e32dd10 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:52.112691 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-41ccfa53-c674-4e4a-985d-0d777e32dd10 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:52.113391 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-41ccfa53-c674-4e4a-985d-0d777e32dd10 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:52.114348 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-41ccfa53-c674-4e4a-985d-0d777e32dd10 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:52.114966 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-41ccfa53-c674-4e4a-985d-0d777e32dd10 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:52.314029 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-41ccfa53-c674-4e4a-985d-0d777e32dd10 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:52.321353 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-41ccfa53-c674-4e4a-985d-0d777e32dd10 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1272 microversion: 2.1 time: 0.226132 Jan 28 01:02:52.325864 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 327/688] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:52 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:52.709347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-48d0503a-0181-41c7-a311-aa970ef074fa req-25e2eb04-ec0c-4ad6-9b24-3bcc89aa9e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e78861-36ac-4839-a201-ad85a067439a", "tag": "2bcf2856-230f-406e-be0e-7ecdcc4a3436"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:52.712812 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:52.712812 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:02:52.723086 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-48d0503a-0181-41c7-a311-aa970ef074fa req-25e2eb04-ec0c-4ad6-9b24-3bcc89aa9e09 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:52.723847 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-48d0503a-0181-41c7-a311-aa970ef074fa req-25e2eb04-ec0c-4ad6-9b24-3bcc89aa9e09 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:52.738112 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-48d0503a-0181-41c7-a311-aa970ef074fa req-25e2eb04-ec0c-4ad6-9b24-3bcc89aa9e09 service nova] Creating event network-changed:2bcf2856-230f-406e-be0e-7ecdcc4a3436 for instance 47e78861-36ac-4839-a201-ad85a067439a on hv-cinder-81689 Jan 28 01:02:52.744578 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-48d0503a-0181-41c7-a311-aa970ef074fa req-25e2eb04-ec0c-4ad6-9b24-3bcc89aa9e09 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039089 Jan 28 01:02:52.745448 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 362/689] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:52.840952 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3f06cf03-8e09-4219-bff2-74ab71f9b7ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:52.841571 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3f06cf03-8e09-4219-bff2-74ab71f9b7ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:52.848074 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f06cf03-8e09-4219-bff2-74ab71f9b7ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:52.848742 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f06cf03-8e09-4219-bff2-74ab71f9b7ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:52.849724 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f06cf03-8e09-4219-bff2-74ab71f9b7ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:52.850163 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3f06cf03-8e09-4219-bff2-74ab71f9b7ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:52.982418 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3f06cf03-8e09-4219-bff2-74ab71f9b7ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:52.990058 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3f06cf03-8e09-4219-bff2-74ab71f9b7ee tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1318 microversion: 2.1 time: 0.152769 Jan 28 01:02:52.990721 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 328/690] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:52 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:53.020464 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-698c970c-313b-40ad-b9e8-98330eb714e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:53.021465 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-698c970c-313b-40ad-b9e8-98330eb714e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:53.029177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-698c970c-313b-40ad-b9e8-98330eb714e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:53.029639 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-698c970c-313b-40ad-b9e8-98330eb714e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:53.030439 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-698c970c-313b-40ad-b9e8-98330eb714e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:53.030895 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-698c970c-313b-40ad-b9e8-98330eb714e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:53.148388 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-698c970c-313b-40ad-b9e8-98330eb714e3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28212 microversion: 2.20 time: 0.131802 Jan 28 01:02:53.149297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 363/691] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:53 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28212 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:53.339389 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-99897657-2be8-417f-ba78-d6dd236b0b2b tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:53.340009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-99897657-2be8-417f-ba78-d6dd236b0b2b tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:53.346113 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99897657-2be8-417f-ba78-d6dd236b0b2b tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:53.346571 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99897657-2be8-417f-ba78-d6dd236b0b2b tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:53.347467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99897657-2be8-417f-ba78-d6dd236b0b2b tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:53.347910 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-99897657-2be8-417f-ba78-d6dd236b0b2b tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:53.485945 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-99897657-2be8-417f-ba78-d6dd236b0b2b tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:53.495803 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-99897657-2be8-417f-ba78-d6dd236b0b2b tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.160024 Jan 28 01:02:53.496387 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 329/692] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:53 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:54.007323 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6851c84d-db1b-4872-b4f7-79d231e68d69 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:54.008038 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6851c84d-db1b-4872-b4f7-79d231e68d69 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:54.015774 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6851c84d-db1b-4872-b4f7-79d231e68d69 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:54.016224 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6851c84d-db1b-4872-b4f7-79d231e68d69 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:54.017006 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6851c84d-db1b-4872-b4f7-79d231e68d69 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:54.017439 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6851c84d-db1b-4872-b4f7-79d231e68d69 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:54.244983 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6851c84d-db1b-4872-b4f7-79d231e68d69 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:54.256794 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6851c84d-db1b-4872-b4f7-79d231e68d69 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1318 microversion: 2.1 time: 0.253201 Jan 28 01:02:54.257667 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 364/693] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:54 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:54.300909 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b1c06dd5-c35d-4ffb-a6aa-d73efd2a3746 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:54.301891 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b1c06dd5-c35d-4ffb-a6aa-d73efd2a3746 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:54.310711 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b1c06dd5-c35d-4ffb-a6aa-d73efd2a3746 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:54.311231 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b1c06dd5-c35d-4ffb-a6aa-d73efd2a3746 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:54.312047 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b1c06dd5-c35d-4ffb-a6aa-d73efd2a3746 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:54.312512 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b1c06dd5-c35d-4ffb-a6aa-d73efd2a3746 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:54.431595 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b1c06dd5-c35d-4ffb-a6aa-d73efd2a3746 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28212 microversion: 2.20 time: 0.270612 Jan 28 01:02:54.432137 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 330/694] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:54 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28212 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:02:54.512991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-dee838e1-cf4a-472c-acfa-08d982b29191 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:54.513607 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-dee838e1-cf4a-472c-acfa-08d982b29191 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:54.522136 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dee838e1-cf4a-472c-acfa-08d982b29191 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:54.522590 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dee838e1-cf4a-472c-acfa-08d982b29191 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:54.523409 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dee838e1-cf4a-472c-acfa-08d982b29191 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:54.523844 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-dee838e1-cf4a-472c-acfa-08d982b29191 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:54.662661 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-dee838e1-cf4a-472c-acfa-08d982b29191 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:54.674071 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-dee838e1-cf4a-472c-acfa-08d982b29191 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.165155 Jan 28 01:02:54.674854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 365/695] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:54 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:55.274727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-44d337c6-e342-41b6-a41a-01eab39c4b08 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:55.276591 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-44d337c6-e342-41b6-a41a-01eab39c4b08 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:55.283396 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-44d337c6-e342-41b6-a41a-01eab39c4b08 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:55.283841 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-44d337c6-e342-41b6-a41a-01eab39c4b08 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:55.284613 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-44d337c6-e342-41b6-a41a-01eab39c4b08 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:55.285045 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-44d337c6-e342-41b6-a41a-01eab39c4b08 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:55.413994 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-44d337c6-e342-41b6-a41a-01eab39c4b08 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:55.422080 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-44d337c6-e342-41b6-a41a-01eab39c4b08 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1508 microversion: 2.1 time: 0.151345 Jan 28 01:02:55.422659 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 331/696] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:55 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:55.443108 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-89698110-4077-48ee-b720-3e23fba5d8f5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:55.444031 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-89698110-4077-48ee-b720-3e23fba5d8f5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:55.451122 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-89698110-4077-48ee-b720-3e23fba5d8f5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:55.451580 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-89698110-4077-48ee-b720-3e23fba5d8f5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:55.452378 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-89698110-4077-48ee-b720-3e23fba5d8f5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:55.453821 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-89698110-4077-48ee-b720-3e23fba5d8f5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:55.561323 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-89698110-4077-48ee-b720-3e23fba5d8f5 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28502 microversion: 2.20 time: 0.121667 Jan 28 01:02:55.561975 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 366/697] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:55 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28502 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:55.691501 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1b137c3b-2ced-4301-b7d8-a4547286b61c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:55.692121 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1b137c3b-2ced-4301-b7d8-a4547286b61c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:55.699935 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1b137c3b-2ced-4301-b7d8-a4547286b61c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:55.700330 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1b137c3b-2ced-4301-b7d8-a4547286b61c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:55.701150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1b137c3b-2ced-4301-b7d8-a4547286b61c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:55.701598 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1b137c3b-2ced-4301-b7d8-a4547286b61c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:55.842242 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1b137c3b-2ced-4301-b7d8-a4547286b61c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:55.850013 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1b137c3b-2ced-4301-b7d8-a4547286b61c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.162066 Jan 28 01:02:55.850725 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 332/698] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:55 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:56.574445 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c6444bfe-a56e-47f0-ad7b-2d044e0d39ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:56.575505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c6444bfe-a56e-47f0-ad7b-2d044e0d39ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:56.583865 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c6444bfe-a56e-47f0-ad7b-2d044e0d39ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:56.584646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c6444bfe-a56e-47f0-ad7b-2d044e0d39ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:56.585183 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c6444bfe-a56e-47f0-ad7b-2d044e0d39ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:56.585737 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c6444bfe-a56e-47f0-ad7b-2d044e0d39ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:56.732809 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c6444bfe-a56e-47f0-ad7b-2d044e0d39ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28670 microversion: 2.20 time: 0.162663 Jan 28 01:02:56.736701 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 367/699] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:56 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:02:56.737955 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-030d4771-375e-4761-99ec-223fcde7a860 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "656f6b3d-1cc2-4dcc-a0cb-b7a579912d00"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:56.739143 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-030d4771-375e-4761-99ec-223fcde7a860 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:56.746498 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-030d4771-375e-4761-99ec-223fcde7a860 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:56.746980 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-030d4771-375e-4761-99ec-223fcde7a860 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:56.747783 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-030d4771-375e-4761-99ec-223fcde7a860 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:56.748228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-030d4771-375e-4761-99ec-223fcde7a860 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:56.868009 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3bc0350c-c939-40bd-839a-e10a32199b87 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:56.868712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3bc0350c-c939-40bd-839a-e10a32199b87 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:56.875818 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bc0350c-c939-40bd-839a-e10a32199b87 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:56.876280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bc0350c-c939-40bd-839a-e10a32199b87 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:56.877058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bc0350c-c939-40bd-839a-e10a32199b87 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:56.877496 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3bc0350c-c939-40bd-839a-e10a32199b87 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:57.014644 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3bc0350c-c939-40bd-839a-e10a32199b87 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:57.022475 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3bc0350c-c939-40bd-839a-e10a32199b87 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.158821 Jan 28 01:02:57.023045 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 368/700] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:56 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:57.036056 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-030d4771-375e-4761-99ec-223fcde7a860 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "POST /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301733 Jan 28 01:02:57.037004 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 333/701] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:02:56 2022] POST /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:57.744906 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9b4847ae-fc9f-48a5-8962-9faa11d18c36 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:57.745828 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9b4847ae-fc9f-48a5-8962-9faa11d18c36 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:57.752979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b4847ae-fc9f-48a5-8962-9faa11d18c36 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:57.753433 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b4847ae-fc9f-48a5-8962-9faa11d18c36 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:57.754218 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b4847ae-fc9f-48a5-8962-9faa11d18c36 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:57.754655 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9b4847ae-fc9f-48a5-8962-9faa11d18c36 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:57.862980 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9b4847ae-fc9f-48a5-8962-9faa11d18c36 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28670 microversion: 2.20 time: 0.122156 Jan 28 01:02:57.863821 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 369/702] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:57 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28670 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:58.042137 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3e5181fb-fbab-4631-9024-18527f562068 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:58.042759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3e5181fb-fbab-4631-9024-18527f562068 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:58.048925 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3e5181fb-fbab-4631-9024-18527f562068 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:58.049372 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3e5181fb-fbab-4631-9024-18527f562068 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:58.050143 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3e5181fb-fbab-4631-9024-18527f562068 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:58.050576 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3e5181fb-fbab-4631-9024-18527f562068 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:58.179971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3e5181fb-fbab-4631-9024-18527f562068 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:58.187973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3e5181fb-fbab-4631-9024-18527f562068 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.151106 Jan 28 01:02:58.188546 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 334/703] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:58 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:58.875285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-05f18a37-fe5b-4e36-a281-efebd2d66629 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:58.876271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-05f18a37-fe5b-4e36-a281-efebd2d66629 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:58.883153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-05f18a37-fe5b-4e36-a281-efebd2d66629 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:58.883603 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-05f18a37-fe5b-4e36-a281-efebd2d66629 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:58.884869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-05f18a37-fe5b-4e36-a281-efebd2d66629 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:58.885302 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-05f18a37-fe5b-4e36-a281-efebd2d66629 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:59.000143 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-05f18a37-fe5b-4e36-a281-efebd2d66629 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28670 microversion: 2.20 time: 0.128780 Jan 28 01:02:59.001033 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 370/704] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:02:58 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28670 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:02:59.204200 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-36de0945-b737-42c7-95fb-c32189d6467e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:59.204815 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-36de0945-b737-42c7-95fb-c32189d6467e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:59.211084 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-36de0945-b737-42c7-95fb-c32189d6467e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:59.211538 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-36de0945-b737-42c7-95fb-c32189d6467e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:59.212319 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-36de0945-b737-42c7-95fb-c32189d6467e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:59.212756 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-36de0945-b737-42c7-95fb-c32189d6467e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:59.339455 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-36de0945-b737-42c7-95fb-c32189d6467e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:59.346622 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-36de0945-b737-42c7-95fb-c32189d6467e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.146069 Jan 28 01:02:59.347204 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 335/705] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:59 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:00.012309 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f0f7d1d4-3d5b-48b1-8e4f-ec29cb1c7a65 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:00.013305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f0f7d1d4-3d5b-48b1-8e4f-ec29cb1c7a65 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:00.020286 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f0f7d1d4-3d5b-48b1-8e4f-ec29cb1c7a65 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:00.020743 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f0f7d1d4-3d5b-48b1-8e4f-ec29cb1c7a65 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:00.021527 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f0f7d1d4-3d5b-48b1-8e4f-ec29cb1c7a65 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:00.021969 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f0f7d1d4-3d5b-48b1-8e4f-ec29cb1c7a65 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:00.123827 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f0f7d1d4-3d5b-48b1-8e4f-ec29cb1c7a65 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28670 microversion: 2.20 time: 0.115394 Jan 28 01:03:00.124460 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 371/706] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:00 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28670 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:00.363128 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8500c6f3-ff4e-4a2d-a7b2-627d63c520b4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:00.363665 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8500c6f3-ff4e-4a2d-a7b2-627d63c520b4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:00.370499 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8500c6f3-ff4e-4a2d-a7b2-627d63c520b4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:00.370974 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8500c6f3-ff4e-4a2d-a7b2-627d63c520b4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:00.371759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8500c6f3-ff4e-4a2d-a7b2-627d63c520b4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:00.372199 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8500c6f3-ff4e-4a2d-a7b2-627d63c520b4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:00.506668 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8500c6f3-ff4e-4a2d-a7b2-627d63c520b4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:00.514367 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8500c6f3-ff4e-4a2d-a7b2-627d63c520b4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.154982 Jan 28 01:03:00.514947 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 336/707] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:00 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:01.136000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0d822ea2-1075-4648-a724-b9b06e9da3d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:01.137135 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0d822ea2-1075-4648-a724-b9b06e9da3d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:01.144179 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d822ea2-1075-4648-a724-b9b06e9da3d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:01.144631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d822ea2-1075-4648-a724-b9b06e9da3d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:01.145417 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d822ea2-1075-4648-a724-b9b06e9da3d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:01.145857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0d822ea2-1075-4648-a724-b9b06e9da3d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:01.250507 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0d822ea2-1075-4648-a724-b9b06e9da3d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28670 microversion: 2.20 time: 0.118353 Jan 28 01:03:01.252313 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 372/708] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:01 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28670 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:01.531676 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4243cf51-a9c3-48ae-9301-7a25fb5cb839 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:01.532298 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4243cf51-a9c3-48ae-9301-7a25fb5cb839 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:01.538726 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4243cf51-a9c3-48ae-9301-7a25fb5cb839 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:01.539245 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4243cf51-a9c3-48ae-9301-7a25fb5cb839 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:01.540032 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4243cf51-a9c3-48ae-9301-7a25fb5cb839 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:01.541031 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4243cf51-a9c3-48ae-9301-7a25fb5cb839 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:01.669587 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4243cf51-a9c3-48ae-9301-7a25fb5cb839 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:01.677131 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4243cf51-a9c3-48ae-9301-7a25fb5cb839 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.149119 Jan 28 01:03:01.677705 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 337/709] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:01 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:02.262633 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3400e8b7-55c7-40bd-8d77-abc4ec49b501 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:02.263657 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3400e8b7-55c7-40bd-8d77-abc4ec49b501 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:02.270413 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3400e8b7-55c7-40bd-8d77-abc4ec49b501 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:02.270855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3400e8b7-55c7-40bd-8d77-abc4ec49b501 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:02.272821 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3400e8b7-55c7-40bd-8d77-abc4ec49b501 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:02.272943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3400e8b7-55c7-40bd-8d77-abc4ec49b501 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:02.414938 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3400e8b7-55c7-40bd-8d77-abc4ec49b501 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28670 microversion: 2.20 time: 0.156123 Jan 28 01:03:02.418320 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 373/710] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:02 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:02.693502 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1da12247-f34b-4061-a32d-77d4c0e65268 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:02.694077 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1da12247-f34b-4061-a32d-77d4c0e65268 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:02.700935 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1da12247-f34b-4061-a32d-77d4c0e65268 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:02.701389 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1da12247-f34b-4061-a32d-77d4c0e65268 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:02.702175 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1da12247-f34b-4061-a32d-77d4c0e65268 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:02.702621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1da12247-f34b-4061-a32d-77d4c0e65268 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:02.832919 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1da12247-f34b-4061-a32d-77d4c0e65268 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:02.840957 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1da12247-f34b-4061-a32d-77d4c0e65268 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.151204 Jan 28 01:03:02.841539 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 338/711] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:02 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:03.426767 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ff5fd06c-a002-4033-bb42-eee909d7b4d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:03.427773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ff5fd06c-a002-4033-bb42-eee909d7b4d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:03.435182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ff5fd06c-a002-4033-bb42-eee909d7b4d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:03.435626 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ff5fd06c-a002-4033-bb42-eee909d7b4d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:03.436394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ff5fd06c-a002-4033-bb42-eee909d7b4d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:03.436824 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ff5fd06c-a002-4033-bb42-eee909d7b4d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:03.549057 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ff5fd06c-a002-4033-bb42-eee909d7b4d0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 28670 microversion: 2.20 time: 0.126032 Jan 28 01:03:03.550142 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 374/712] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:03 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 28670 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:03.858007 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d85e4811-b857-4d54-b4f7-abb7a3f9f06f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:03.858712 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d85e4811-b857-4d54-b4f7-abb7a3f9f06f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:03.865479 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d85e4811-b857-4d54-b4f7-abb7a3f9f06f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:03.865925 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d85e4811-b857-4d54-b4f7-abb7a3f9f06f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:03.866716 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d85e4811-b857-4d54-b4f7-abb7a3f9f06f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:03.867176 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d85e4811-b857-4d54-b4f7-abb7a3f9f06f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:03.924827 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-38d78928-6d8b-4324-8f4b-7b6dc364b724 req-f29db95f-bf5a-4ace-a340-91c768966d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e78861-36ac-4839-a201-ad85a067439a", "name": "network-vif-plugged", "status": "completed", "tag": "2bcf2856-230f-406e-be0e-7ecdcc4a3436"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:03.926505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:03.926505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:03:03.935466 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-38d78928-6d8b-4324-8f4b-7b6dc364b724 req-f29db95f-bf5a-4ace-a340-91c768966d39 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:03.935989 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-38d78928-6d8b-4324-8f4b-7b6dc364b724 req-f29db95f-bf5a-4ace-a340-91c768966d39 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:03.948188 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-38d78928-6d8b-4324-8f4b-7b6dc364b724 req-f29db95f-bf5a-4ace-a340-91c768966d39 service nova] Creating event network-vif-plugged:2bcf2856-230f-406e-be0e-7ecdcc4a3436 for instance 47e78861-36ac-4839-a201-ad85a067439a on hv-cinder-81689 Jan 28 01:03:03.958000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-38d78928-6d8b-4324-8f4b-7b6dc364b724 req-f29db95f-bf5a-4ace-a340-91c768966d39 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037275 Jan 28 01:03:03.958000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 375/713] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:03:04.017384 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d85e4811-b857-4d54-b4f7-abb7a3f9f06f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:04.025649 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d85e4811-b857-4d54-b4f7-abb7a3f9f06f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.170495 Jan 28 01:03:04.026285 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 339/714] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:03 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:04.562757 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ec6643a1-68f5-4028-8b7d-17876efa8b77 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:04.563791 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ec6643a1-68f5-4028-8b7d-17876efa8b77 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:04.571469 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ec6643a1-68f5-4028-8b7d-17876efa8b77 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:04.572102 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ec6643a1-68f5-4028-8b7d-17876efa8b77 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:04.572980 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ec6643a1-68f5-4028-8b7d-17876efa8b77 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:04.573423 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ec6643a1-68f5-4028-8b7d-17876efa8b77 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:04.629652 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d178a188-b1d1-4ea4-bd3c-98cf84da93b2 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:04.630447 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d178a188-b1d1-4ea4-bd3c-98cf84da93b2 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:04.640249 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d178a188-b1d1-4ea4-bd3c-98cf84da93b2 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:04.640995 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d178a188-b1d1-4ea4-bd3c-98cf84da93b2 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:04.642334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d178a188-b1d1-4ea4-bd3c-98cf84da93b2 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:04.642840 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d178a188-b1d1-4ea4-bd3c-98cf84da93b2 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:04.724451 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-d178a188-b1d1-4ea4-bd3c-98cf84da93b2 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lazy-loading 'services' on Instance uuid 49f18b7d-3661-4a95-9adc-6b3086996175 {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:03:04.796743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d178a188-b1d1-4ea4-bd3c-98cf84da93b2 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "DELETE /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments/656f6b3d-1cc2-4dcc-a0cb-b7a579912d00" status: 202 len: 0 microversion: 2.1 time: 0.173230 Jan 28 01:03:04.797343 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 340/715] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:03:04 2022] DELETE /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments/656f6b3d-1cc2-4dcc-a0cb-b7a579912d00 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:04.805747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a1a64942-6cf1-4227-879c-afd67c8a0bd6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:04.806955 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a1a64942-6cf1-4227-879c-afd67c8a0bd6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:04.813246 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a1a64942-6cf1-4227-879c-afd67c8a0bd6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:04.813695 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a1a64942-6cf1-4227-879c-afd67c8a0bd6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:04.814496 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a1a64942-6cf1-4227-879c-afd67c8a0bd6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:04.814963 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a1a64942-6cf1-4227-879c-afd67c8a0bd6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:04.845658 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a1a64942-6cf1-4227-879c-afd67c8a0bd6 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043693 Jan 28 01:03:04.846147 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 341/716] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:03:04 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:03:04.983979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ec6643a1-68f5-4028-8b7d-17876efa8b77 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 30199 microversion: 2.20 time: 0.425588 Jan 28 01:03:04.984634 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 376/717] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:04 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 30199 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:05.042756 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-17e1a571-a237-4711-91ce-ab9e6b6ffefc tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:05.043483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-17e1a571-a237-4711-91ce-ab9e6b6ffefc tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:05.050704 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-17e1a571-a237-4711-91ce-ab9e6b6ffefc tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:05.051194 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-17e1a571-a237-4711-91ce-ab9e6b6ffefc tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:05.051997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-17e1a571-a237-4711-91ce-ab9e6b6ffefc tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:05.052442 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-17e1a571-a237-4711-91ce-ab9e6b6ffefc tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:05.187615 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-17e1a571-a237-4711-91ce-ab9e6b6ffefc tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:05.195273 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-17e1a571-a237-4711-91ce-ab9e6b6ffefc tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.157254 Jan 28 01:03:05.195855 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 342/718] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:05 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:05.858722 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d4f73d1d-cd54-406a-810f-1391b6c2b10f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:05.859752 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d4f73d1d-cd54-406a-810f-1391b6c2b10f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:05.868071 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d4f73d1d-cd54-406a-810f-1391b6c2b10f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:05.869017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d4f73d1d-cd54-406a-810f-1391b6c2b10f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:05.869815 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d4f73d1d-cd54-406a-810f-1391b6c2b10f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:05.870250 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d4f73d1d-cd54-406a-810f-1391b6c2b10f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:05.902454 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d4f73d1d-cd54-406a-810f-1391b6c2b10f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047925 Jan 28 01:03:05.906409 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 377/719] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:03:05 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:05.996727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4450b1b0-7bf4-4147-ae68-bc9be5d1446c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:05.997679 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4450b1b0-7bf4-4147-ae68-bc9be5d1446c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:06.003755 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4450b1b0-7bf4-4147-ae68-bc9be5d1446c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:06.004211 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4450b1b0-7bf4-4147-ae68-bc9be5d1446c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:06.005004 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4450b1b0-7bf4-4147-ae68-bc9be5d1446c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:06.005439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4450b1b0-7bf4-4147-ae68-bc9be5d1446c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:06.169079 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4450b1b0-7bf4-4147-ae68-bc9be5d1446c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 30914 microversion: 2.20 time: 0.176385 Jan 28 01:03:06.169751 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 343/720] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:05 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 30914 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:06.212852 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d4e76cf8-3dad-413c-88b8-2fbd11cf5979 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:06.213466 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d4e76cf8-3dad-413c-88b8-2fbd11cf5979 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:06.219826 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d4e76cf8-3dad-413c-88b8-2fbd11cf5979 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:06.220406 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d4e76cf8-3dad-413c-88b8-2fbd11cf5979 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:06.221063 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d4e76cf8-3dad-413c-88b8-2fbd11cf5979 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:06.221557 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d4e76cf8-3dad-413c-88b8-2fbd11cf5979 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:06.371971 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d4e76cf8-3dad-413c-88b8-2fbd11cf5979 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:06.379477 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d4e76cf8-3dad-413c-88b8-2fbd11cf5979 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1260 microversion: 2.1 time: 0.170781 Jan 28 01:03:06.380064 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 378/721] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:06 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:06.914214 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a44da1f7-492f-4c50-ba9b-7e1dabc30c13 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:06.915328 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a44da1f7-492f-4c50-ba9b-7e1dabc30c13 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:06.922694 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a44da1f7-492f-4c50-ba9b-7e1dabc30c13 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:06.923174 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a44da1f7-492f-4c50-ba9b-7e1dabc30c13 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:06.923965 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a44da1f7-492f-4c50-ba9b-7e1dabc30c13 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:06.924393 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a44da1f7-492f-4c50-ba9b-7e1dabc30c13 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:06.955481 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a44da1f7-492f-4c50-ba9b-7e1dabc30c13 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045390 Jan 28 01:03:06.956038 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 344/722] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:03:06 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:03:07.181440 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f5f8fffc-4d77-4476-ac06-7d39f60e2e9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:07.182267 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f5f8fffc-4d77-4476-ac06-7d39f60e2e9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:07.188582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5f8fffc-4d77-4476-ac06-7d39f60e2e9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:07.189028 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5f8fffc-4d77-4476-ac06-7d39f60e2e9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:07.189807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5f8fffc-4d77-4476-ac06-7d39f60e2e9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:07.190239 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5f8fffc-4d77-4476-ac06-7d39f60e2e9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:07.319942 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f5f8fffc-4d77-4476-ac06-7d39f60e2e9a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 33149 microversion: 2.20 time: 0.142704 Jan 28 01:03:07.320599 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 379/723] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:07 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 33149 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:07.396082 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f9082b0f-adcf-41ed-a26f-3babe46a8c2e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:07.396723 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f9082b0f-adcf-41ed-a26f-3babe46a8c2e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:07.404757 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f9082b0f-adcf-41ed-a26f-3babe46a8c2e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:07.405313 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f9082b0f-adcf-41ed-a26f-3babe46a8c2e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:07.406150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f9082b0f-adcf-41ed-a26f-3babe46a8c2e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:07.406588 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f9082b0f-adcf-41ed-a26f-3babe46a8c2e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:07.548467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f9082b0f-adcf-41ed-a26f-3babe46a8c2e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:07.556407 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f9082b0f-adcf-41ed-a26f-3babe46a8c2e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1445 microversion: 2.1 time: 0.163490 Jan 28 01:03:07.556974 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 345/724] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:07 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:07.573078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2eff3bab-6ef4-4d70-8206-6be95657bd92 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:07.573804 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2eff3bab-6ef4-4d70-8206-6be95657bd92 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:07.580867 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2eff3bab-6ef4-4d70-8206-6be95657bd92 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:07.581311 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2eff3bab-6ef4-4d70-8206-6be95657bd92 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:07.582091 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2eff3bab-6ef4-4d70-8206-6be95657bd92 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:07.582524 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2eff3bab-6ef4-4d70-8206-6be95657bd92 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:07.724649 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2eff3bab-6ef4-4d70-8206-6be95657bd92 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:07.733025 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2eff3bab-6ef4-4d70-8206-6be95657bd92 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1445 microversion: 2.1 time: 0.164589 Jan 28 01:03:07.733597 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 380/725] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:07 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1445 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:03:08.146458 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f35eda67-0e16-40b7-a55d-e4db96ee414b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:08.146745 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f35eda67-0e16-40b7-a55d-e4db96ee414b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:08.153935 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f35eda67-0e16-40b7-a55d-e4db96ee414b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:08.154586 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f35eda67-0e16-40b7-a55d-e4db96ee414b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:08.155299 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f35eda67-0e16-40b7-a55d-e4db96ee414b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:08.155673 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f35eda67-0e16-40b7-a55d-e4db96ee414b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:08.183076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f35eda67-0e16-40b7-a55d-e4db96ee414b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:03:08.271100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f35eda67-0e16-40b7-a55d-e4db96ee414b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "DELETE /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 204 len: 0 microversion: 2.1 time: 0.126673 Jan 28 01:03:08.272022 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 346/726] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:03:08 2022] DELETE /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:03:08.280625 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3486ce5c-f5d8-44d8-b66d-eba2831a0464 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:08.281285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3486ce5c-f5d8-44d8-b66d-eba2831a0464 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:08.288355 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3486ce5c-f5d8-44d8-b66d-eba2831a0464 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:08.288814 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3486ce5c-f5d8-44d8-b66d-eba2831a0464 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:08.289618 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3486ce5c-f5d8-44d8-b66d-eba2831a0464 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:08.290058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3486ce5c-f5d8-44d8-b66d-eba2831a0464 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:08.332454 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-10143def-e67d-47b3-8c61-0ca09fc5b84a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:08.333406 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-10143def-e67d-47b3-8c61-0ca09fc5b84a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:08.340078 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-10143def-e67d-47b3-8c61-0ca09fc5b84a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:08.340534 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-10143def-e67d-47b3-8c61-0ca09fc5b84a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:08.341331 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-10143def-e67d-47b3-8c61-0ca09fc5b84a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:08.341769 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-10143def-e67d-47b3-8c61-0ca09fc5b84a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:08.480908 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-10143def-e67d-47b3-8c61-0ca09fc5b84a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 33901 microversion: 2.20 time: 0.152490 Jan 28 01:03:08.485040 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 347/727] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:08 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 33901 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:03:08.583807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3486ce5c-f5d8-44d8-b66d-eba2831a0464 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:08.591234 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3486ce5c-f5d8-44d8-b66d-eba2831a0464 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1514 microversion: 2.1 time: 0.314419 Jan 28 01:03:08.591822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 381/728] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:08 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1514 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:03:09.494819 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cca0a98b-a6fa-4c49-9a9c-7dfda85a6210 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:09.496568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cca0a98b-a6fa-4c49-9a9c-7dfda85a6210 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:09.504115 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cca0a98b-a6fa-4c49-9a9c-7dfda85a6210 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:09.504708 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cca0a98b-a6fa-4c49-9a9c-7dfda85a6210 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:09.505580 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cca0a98b-a6fa-4c49-9a9c-7dfda85a6210 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:09.506088 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cca0a98b-a6fa-4c49-9a9c-7dfda85a6210 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:09.613274 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-bc5f318c-3eba-4760-a2db-b9c6cef11807 req-442d5a29-e72e-486b-a9b9-8432948aea4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e78861-36ac-4839-a201-ad85a067439a", "tag": "2bcf2856-230f-406e-be0e-7ecdcc4a3436"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:09.614841 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:09.614841 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:03:09.622751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-bc5f318c-3eba-4760-a2db-b9c6cef11807 req-442d5a29-e72e-486b-a9b9-8432948aea4d service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:09.623228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-bc5f318c-3eba-4760-a2db-b9c6cef11807 req-442d5a29-e72e-486b-a9b9-8432948aea4d service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:09.635619 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-bc5f318c-3eba-4760-a2db-b9c6cef11807 req-442d5a29-e72e-486b-a9b9-8432948aea4d service nova] Creating event network-changed:2bcf2856-230f-406e-be0e-7ecdcc4a3436 for instance 47e78861-36ac-4839-a201-ad85a067439a on hv-cinder-81689 Jan 28 01:03:09.643899 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-bc5f318c-3eba-4760-a2db-b9c6cef11807 req-442d5a29-e72e-486b-a9b9-8432948aea4d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099030 Jan 28 01:03:09.644182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 382/729] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:09.651187 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6fd6989c-7e46-47cb-ad3d-b69a74ac367c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:09.651805 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cca0a98b-a6fa-4c49-9a9c-7dfda85a6210 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 34411 microversion: 2.20 time: 0.162519 Jan 28 01:03:09.651935 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6fd6989c-7e46-47cb-ad3d-b69a74ac367c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:09.652449 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 348/730] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:09 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 34411 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:09.658329 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6fd6989c-7e46-47cb-ad3d-b69a74ac367c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:09.658781 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6fd6989c-7e46-47cb-ad3d-b69a74ac367c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:09.659607 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6fd6989c-7e46-47cb-ad3d-b69a74ac367c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:09.660047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6fd6989c-7e46-47cb-ad3d-b69a74ac367c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:09.877103 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6fd6989c-7e46-47cb-ad3d-b69a74ac367c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:09.884988 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6fd6989c-7e46-47cb-ad3d-b69a74ac367c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1514 microversion: 2.1 time: 0.239443 Jan 28 01:03:09.885575 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 383/731] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:09 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:10.664641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-dcd3e4f2-2dc0-4bc6-ba3e-7b6fa287d960 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:10.666068 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-dcd3e4f2-2dc0-4bc6-ba3e-7b6fa287d960 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:10.673603 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dcd3e4f2-2dc0-4bc6-ba3e-7b6fa287d960 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:10.674062 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dcd3e4f2-2dc0-4bc6-ba3e-7b6fa287d960 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:10.674872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dcd3e4f2-2dc0-4bc6-ba3e-7b6fa287d960 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:10.675342 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dcd3e4f2-2dc0-4bc6-ba3e-7b6fa287d960 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:10.783382 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-dcd3e4f2-2dc0-4bc6-ba3e-7b6fa287d960 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 34940 microversion: 2.20 time: 0.122705 Jan 28 01:03:10.784038 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 349/732] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:10 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 34940 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:10.902535 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-332427a9-bec6-42ae-a897-e3b0090a2027 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:10.903183 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-332427a9-bec6-42ae-a897-e3b0090a2027 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:10.909817 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-332427a9-bec6-42ae-a897-e3b0090a2027 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:10.910271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-332427a9-bec6-42ae-a897-e3b0090a2027 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:10.911120 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-332427a9-bec6-42ae-a897-e3b0090a2027 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:10.911767 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-332427a9-bec6-42ae-a897-e3b0090a2027 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:11.123231 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-332427a9-bec6-42ae-a897-e3b0090a2027 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:11.130654 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-332427a9-bec6-42ae-a897-e3b0090a2027 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1514 microversion: 2.1 time: 0.232554 Jan 28 01:03:11.131406 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 384/733] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:10 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:11.660794 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-ad5ac84a-a2e5-4536-ab45-180087d87b7a req-831812d8-c8fa-4218-b7d5-6dd915c1be6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f18b7d-3661-4a95-9adc-6b3086996175", "name": "network-vif-deleted", "tag": "5675595b-a397-4283-a05e-85b239e3bbc1"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:11.662299 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:11.662299 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:03:11.670597 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-ad5ac84a-a2e5-4536-ab45-180087d87b7a req-831812d8-c8fa-4218-b7d5-6dd915c1be6f service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:11.671535 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-ad5ac84a-a2e5-4536-ab45-180087d87b7a req-831812d8-c8fa-4218-b7d5-6dd915c1be6f service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:11.684071 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-ad5ac84a-a2e5-4536-ab45-180087d87b7a req-831812d8-c8fa-4218-b7d5-6dd915c1be6f service nova] Creating event network-vif-deleted:5675595b-a397-4283-a05e-85b239e3bbc1 for instance 49f18b7d-3661-4a95-9adc-6b3086996175 on hv-cinder-81689 Jan 28 01:03:11.689575 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-ad5ac84a-a2e5-4536-ab45-180087d87b7a req-831812d8-c8fa-4218-b7d5-6dd915c1be6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032472 Jan 28 01:03:11.690384 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 350/734] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:03:11.795314 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d583598d-d267-48a1-88fc-846d9e83f605 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:11.796218 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d583598d-d267-48a1-88fc-846d9e83f605 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:11.802609 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d583598d-d267-48a1-88fc-846d9e83f605 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:11.803525 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d583598d-d267-48a1-88fc-846d9e83f605 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:11.803525 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d583598d-d267-48a1-88fc-846d9e83f605 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:11.803920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d583598d-d267-48a1-88fc-846d9e83f605 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:11.929521 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d583598d-d267-48a1-88fc-846d9e83f605 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 35697 microversion: 2.20 time: 0.137616 Jan 28 01:03:11.930192 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 385/735] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:11 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 35697 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:12.156247 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:12.157625 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:12.168444 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:12.168903 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:12.169706 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:12.170154 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:12.202255 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:12.203794 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:12.204310 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lazy-loading 'fault' on Instance uuid 49f18b7d-3661-4a95-9adc-6b3086996175 {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:03:12.248562 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:12.255647 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b6cfe60c-b886-4007-a78b-2291bc8ff00e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 200 len: 1308 microversion: 2.1 time: 0.109991 Jan 28 01:03:12.256241 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 351/736] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:12 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:12.942484 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3928a663-c81a-4cf5-a1b5-899b8dcb5485 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:12.943506 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3928a663-c81a-4cf5-a1b5-899b8dcb5485 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:12.950392 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3928a663-c81a-4cf5-a1b5-899b8dcb5485 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:12.950835 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3928a663-c81a-4cf5-a1b5-899b8dcb5485 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:12.951636 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3928a663-c81a-4cf5-a1b5-899b8dcb5485 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:12.952071 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3928a663-c81a-4cf5-a1b5-899b8dcb5485 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:13.076254 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3928a663-c81a-4cf5-a1b5-899b8dcb5485 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 36532 microversion: 2.20 time: 0.137748 Jan 28 01:03:13.076903 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 386/737] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:12 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 36532 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:13.273268 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-97813d68-667b-4f4b-b13a-894ac2c440e7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:13.273881 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-97813d68-667b-4f4b-b13a-894ac2c440e7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 49f18b7d-3661-4a95-9adc-6b3086996175] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:13.280558 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97813d68-667b-4f4b-b13a-894ac2c440e7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:13.281000 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97813d68-667b-4f4b-b13a-894ac2c440e7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:13.281790 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97813d68-667b-4f4b-b13a-894ac2c440e7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:13.282235 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97813d68-667b-4f4b-b13a-894ac2c440e7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:13.296530 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-97813d68-667b-4f4b-b13a-894ac2c440e7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] HTTP exception thrown: Instance 49f18b7d-3661-4a95-9adc-6b3086996175 could not be found. Jan 28 01:03:13.297131 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-97813d68-667b-4f4b-b13a-894ac2c440e7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Returning 404 to user: Instance 49f18b7d-3661-4a95-9adc-6b3086996175 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:03:13.297970 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-97813d68-667b-4f4b-b13a-894ac2c440e7 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175" status: 404 len: 111 microversion: 2.1 time: 0.028461 Jan 28 01:03:13.298525 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 352/738] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:13 2022] GET /compute/v2.1/servers/49f18b7d-3661-4a95-9adc-6b3086996175 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:03:14.088787 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-58a20955-676b-4af4-ac3f-c4456188f2fb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:14.089714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-58a20955-676b-4af4-ac3f-c4456188f2fb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:14.097137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-58a20955-676b-4af4-ac3f-c4456188f2fb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:14.097594 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-58a20955-676b-4af4-ac3f-c4456188f2fb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:14.098398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-58a20955-676b-4af4-ac3f-c4456188f2fb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:14.098841 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-58a20955-676b-4af4-ac3f-c4456188f2fb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:14.213538 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-58a20955-676b-4af4-ac3f-c4456188f2fb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 37523 microversion: 2.20 time: 0.129238 Jan 28 01:03:14.214211 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 387/739] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:14 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 37523 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:14.436599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-03ec2b5a-0aa8-427b-9648-782ad9d2d421 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:14.437145 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-03ec2b5a-0aa8-427b-9648-782ad9d2d421 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:14.443786 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03ec2b5a-0aa8-427b-9648-782ad9d2d421 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:14.444230 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03ec2b5a-0aa8-427b-9648-782ad9d2d421 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:14.445033 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03ec2b5a-0aa8-427b-9648-782ad9d2d421 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:14.445472 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-03ec2b5a-0aa8-427b-9648-782ad9d2d421 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:14.475098 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-03ec2b5a-0aa8-427b-9648-782ad9d2d421 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:03:14.556625 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-03ec2b5a-0aa8-427b-9648-782ad9d2d421 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 204 len: 0 microversion: 2.1 time: 0.122866 Jan 28 01:03:14.558437 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 353/740] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:03:14 2022] DELETE /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:03:14.566008 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-61d309ff-8619-49a0-868c-be24236d6898 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:14.566716 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-61d309ff-8619-49a0-868c-be24236d6898 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:14.574659 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-61d309ff-8619-49a0-868c-be24236d6898 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:14.575201 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-61d309ff-8619-49a0-868c-be24236d6898 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:14.576009 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-61d309ff-8619-49a0-868c-be24236d6898 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:14.576450 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-61d309ff-8619-49a0-868c-be24236d6898 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:14.717361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-61d309ff-8619-49a0-868c-be24236d6898 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:14.725320 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-61d309ff-8619-49a0-868c-be24236d6898 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1512 microversion: 2.1 time: 0.163274 Jan 28 01:03:14.725918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 388/741] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:14 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:15.226274 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-47965799-cf49-4f4c-90f7-2cff91b4a876 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:15.227834 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-47965799-cf49-4f4c-90f7-2cff91b4a876 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:15.234257 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-47965799-cf49-4f4c-90f7-2cff91b4a876 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:15.234709 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-47965799-cf49-4f4c-90f7-2cff91b4a876 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:15.235547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-47965799-cf49-4f4c-90f7-2cff91b4a876 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:15.235993 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-47965799-cf49-4f4c-90f7-2cff91b4a876 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:15.347260 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-47965799-cf49-4f4c-90f7-2cff91b4a876 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 38161 microversion: 2.20 time: 0.125015 Jan 28 01:03:15.347911 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 354/742] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:15 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 38161 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:15.742391 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d1379ca0-9073-43bc-8ede-3f884b733f1c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:15.743626 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d1379ca0-9073-43bc-8ede-3f884b733f1c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:15.750104 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1379ca0-9073-43bc-8ede-3f884b733f1c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:15.750559 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1379ca0-9073-43bc-8ede-3f884b733f1c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:15.751373 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1379ca0-9073-43bc-8ede-3f884b733f1c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:15.751989 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1379ca0-9073-43bc-8ede-3f884b733f1c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:15.888488 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d1379ca0-9073-43bc-8ede-3f884b733f1c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:15.896717 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d1379ca0-9073-43bc-8ede-3f884b733f1c tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1512 microversion: 2.1 time: 0.158009 Jan 28 01:03:15.897287 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 389/743] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:15 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:16.360429 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a61c92a5-5385-4e9d-ab95-ecac387d600c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:16.361468 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a61c92a5-5385-4e9d-ab95-ecac387d600c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:16.368672 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a61c92a5-5385-4e9d-ab95-ecac387d600c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:16.369121 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a61c92a5-5385-4e9d-ab95-ecac387d600c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:16.369904 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a61c92a5-5385-4e9d-ab95-ecac387d600c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:16.370340 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a61c92a5-5385-4e9d-ab95-ecac387d600c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:16.482064 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a61c92a5-5385-4e9d-ab95-ecac387d600c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 38161 microversion: 2.20 time: 0.125592 Jan 28 01:03:16.482735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 355/744] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:16 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 38161 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:03:16.914729 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a47e26d2-37e9-4374-a8a1-32c2ac8f693a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:16.915428 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a47e26d2-37e9-4374-a8a1-32c2ac8f693a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:16.922307 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a47e26d2-37e9-4374-a8a1-32c2ac8f693a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:16.922767 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a47e26d2-37e9-4374-a8a1-32c2ac8f693a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:16.923607 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a47e26d2-37e9-4374-a8a1-32c2ac8f693a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:16.924051 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a47e26d2-37e9-4374-a8a1-32c2ac8f693a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:17.328341 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a47e26d2-37e9-4374-a8a1-32c2ac8f693a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:17.336058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a47e26d2-37e9-4374-a8a1-32c2ac8f693a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 200 len: 1512 microversion: 2.1 time: 0.426225 Jan 28 01:03:17.336633 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 390/745] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:16 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:17.496935 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5ab18a51-11f9-4894-8e85-292f15a947d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:17.497953 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5ab18a51-11f9-4894-8e85-292f15a947d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:17.505905 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5ab18a51-11f9-4894-8e85-292f15a947d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:17.506357 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5ab18a51-11f9-4894-8e85-292f15a947d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:17.507345 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5ab18a51-11f9-4894-8e85-292f15a947d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:17.508677 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5ab18a51-11f9-4894-8e85-292f15a947d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:17.511358 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-d3ecff92-97ae-41dc-a9d9-fc09b5dcd3ef req-7d7da6a9-769b-4f8c-b90e-975279e12d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31677564-4255-423a-b0c3-c971c15d7088", "name": "network-vif-deleted", "tag": "7dc14b94-86ca-45c6-8d82-f843ddbc5a06"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:17.513090 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:17.513090 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:03:17.521596 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-d3ecff92-97ae-41dc-a9d9-fc09b5dcd3ef req-7d7da6a9-769b-4f8c-b90e-975279e12d83 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:17.522151 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-d3ecff92-97ae-41dc-a9d9-fc09b5dcd3ef req-7d7da6a9-769b-4f8c-b90e-975279e12d83 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:17.537130 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-d3ecff92-97ae-41dc-a9d9-fc09b5dcd3ef req-7d7da6a9-769b-4f8c-b90e-975279e12d83 service nova] Creating event network-vif-deleted:7dc14b94-86ca-45c6-8d82-f843ddbc5a06 for instance 31677564-4255-423a-b0c3-c971c15d7088 on hv-cinder-81689 Jan 28 01:03:17.543147 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-d3ecff92-97ae-41dc-a9d9-fc09b5dcd3ef req-7d7da6a9-769b-4f8c-b90e-975279e12d83 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040405 Jan 28 01:03:17.544673 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 391/746] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:17.643549 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5ab18a51-11f9-4894-8e85-292f15a947d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 38161 microversion: 2.20 time: 0.152802 Jan 28 01:03:17.644197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 356/747] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:17 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 38161 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:03:18.352410 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bfe88ffc-2427-4f04-b3d6-96fd640af59e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:18.353030 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bfe88ffc-2427-4f04-b3d6-96fd640af59e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 31677564-4255-423a-b0c3-c971c15d7088] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:18.359252 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bfe88ffc-2427-4f04-b3d6-96fd640af59e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:18.359711 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bfe88ffc-2427-4f04-b3d6-96fd640af59e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:18.360655 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bfe88ffc-2427-4f04-b3d6-96fd640af59e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:18.360948 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bfe88ffc-2427-4f04-b3d6-96fd640af59e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:18.373936 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-bfe88ffc-2427-4f04-b3d6-96fd640af59e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] HTTP exception thrown: Instance 31677564-4255-423a-b0c3-c971c15d7088 could not be found. Jan 28 01:03:18.374527 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bfe88ffc-2427-4f04-b3d6-96fd640af59e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Returning 404 to user: Instance 31677564-4255-423a-b0c3-c971c15d7088 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:03:18.375386 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-bfe88ffc-2427-4f04-b3d6-96fd640af59e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088" status: 404 len: 111 microversion: 2.1 time: 0.027179 Jan 28 01:03:18.375920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 392/748] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:18 2022] GET /compute/v2.1/servers/31677564-4255-423a-b0c3-c971c15d7088 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:03:18.384638 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c1376dde-662f-42ad-aaed-7368878ef534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:18.385268 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c1376dde-662f-42ad-aaed-7368878ef534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:18.392224 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c1376dde-662f-42ad-aaed-7368878ef534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:18.392682 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c1376dde-662f-42ad-aaed-7368878ef534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:18.393492 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c1376dde-662f-42ad-aaed-7368878ef534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:18.393937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c1376dde-662f-42ad-aaed-7368878ef534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:18.419757 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c1376dde-662f-42ad-aaed-7368878ef534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:03:18.494206 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c1376dde-662f-42ad-aaed-7368878ef534 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "DELETE /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 204 len: 0 microversion: 2.1 time: 0.113690 Jan 28 01:03:18.494808 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 357/749] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:03:18 2022] DELETE /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:03:18.503045 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c13040ea-b307-4815-99b1-9147c044702b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:18.503658 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c13040ea-b307-4815-99b1-9147c044702b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:18.510321 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c13040ea-b307-4815-99b1-9147c044702b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:18.510777 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c13040ea-b307-4815-99b1-9147c044702b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:18.511577 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c13040ea-b307-4815-99b1-9147c044702b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:18.512010 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c13040ea-b307-4815-99b1-9147c044702b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:18.642983 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c13040ea-b307-4815-99b1-9147c044702b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:18.651229 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c13040ea-b307-4815-99b1-9147c044702b tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1512 microversion: 2.1 time: 0.151895 Jan 28 01:03:18.652040 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 393/750] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:18 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:18.657732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-45734d6a-3d0a-434e-a885-8f30954664b9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:18.658995 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-45734d6a-3d0a-434e-a885-8f30954664b9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:18.665859 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-45734d6a-3d0a-434e-a885-8f30954664b9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:18.666317 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-45734d6a-3d0a-434e-a885-8f30954664b9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:18.667156 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-45734d6a-3d0a-434e-a885-8f30954664b9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:18.667591 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-45734d6a-3d0a-434e-a885-8f30954664b9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:18.763710 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-45734d6a-3d0a-434e-a885-8f30954664b9 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 38161 microversion: 2.20 time: 0.109932 Jan 28 01:03:18.764661 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 358/751] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:18 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 38161 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:19.669382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4a74536f-405d-4c65-b673-1b0c5582a470 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:19.669902 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4a74536f-405d-4c65-b673-1b0c5582a470 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:19.677364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4a74536f-405d-4c65-b673-1b0c5582a470 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:19.677818 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4a74536f-405d-4c65-b673-1b0c5582a470 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:19.678601 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4a74536f-405d-4c65-b673-1b0c5582a470 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:19.679119 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4a74536f-405d-4c65-b673-1b0c5582a470 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:19.776838 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0cbd776e-0fb2-4d99-8bdd-9501d969ffc6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:19.777854 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0cbd776e-0fb2-4d99-8bdd-9501d969ffc6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:19.784563 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0cbd776e-0fb2-4d99-8bdd-9501d969ffc6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:19.785009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0cbd776e-0fb2-4d99-8bdd-9501d969ffc6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:19.785784 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0cbd776e-0fb2-4d99-8bdd-9501d969ffc6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:19.786218 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0cbd776e-0fb2-4d99-8bdd-9501d969ffc6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:19.810864 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4a74536f-405d-4c65-b673-1b0c5582a470 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:19.818358 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4a74536f-405d-4c65-b673-1b0c5582a470 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1512 microversion: 2.1 time: 0.153218 Jan 28 01:03:19.818960 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 394/752] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:19 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:19.906475 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0cbd776e-0fb2-4d99-8bdd-9501d969ffc6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 200 len: 38302 microversion: 2.20 time: 0.134320 Jan 28 01:03:19.907439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 359/753] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:19 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 38302 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:03:19.916704 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-478379fe-4aab-4a65-ab0a-72e2bb752acb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:19.917203 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-478379fe-4aab-4a65-ab0a-72e2bb752acb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:19.923240 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-478379fe-4aab-4a65-ab0a-72e2bb752acb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:19.923694 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-478379fe-4aab-4a65-ab0a-72e2bb752acb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:19.924480 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-478379fe-4aab-4a65-ab0a-72e2bb752acb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:19.924922 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-478379fe-4aab-4a65-ab0a-72e2bb752acb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:19.949558 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-478379fe-4aab-4a65-ab0a-72e2bb752acb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/ips" status: 200 len: 151 microversion: 2.20 time: 0.036425 Jan 28 01:03:19.950138 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 395/754] 10.222.0.78 () {60 vars in 1288 bytes} [Fri Jan 28 01:03:19 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:03:20.740658 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-18a1630e-06e1-462c-b1e4-682a075cc27e req-677a8bb2-12d6-49cf-b9ec-1f4d000ff175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df026b29-203d-4492-892d-45774a906b25", "name": "network-vif-deleted", "tag": "e1715f83-ff51-4c85-b157-6651e8b0d99a"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:20.742268 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:20.742268 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:03:20.751790 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-18a1630e-06e1-462c-b1e4-682a075cc27e req-677a8bb2-12d6-49cf-b9ec-1f4d000ff175 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:20.752236 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-18a1630e-06e1-462c-b1e4-682a075cc27e req-677a8bb2-12d6-49cf-b9ec-1f4d000ff175 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:20.769559 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-18a1630e-06e1-462c-b1e4-682a075cc27e req-677a8bb2-12d6-49cf-b9ec-1f4d000ff175 service nova] Creating event network-vif-deleted:e1715f83-ff51-4c85-b157-6651e8b0d99a for instance df026b29-203d-4492-892d-45774a906b25 on hv-cinder-81689 Jan 28 01:03:20.775997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-18a1630e-06e1-462c-b1e4-682a075cc27e req-677a8bb2-12d6-49cf-b9ec-1f4d000ff175 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038179 Jan 28 01:03:20.776624 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 360/755] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:20.836133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c0b05e4a-0e83-497a-a9be-54cabcf8986e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:20.837313 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c0b05e4a-0e83-497a-a9be-54cabcf8986e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:20.844123 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c0b05e4a-0e83-497a-a9be-54cabcf8986e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:20.844583 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c0b05e4a-0e83-497a-a9be-54cabcf8986e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:20.845583 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c0b05e4a-0e83-497a-a9be-54cabcf8986e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:20.846097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c0b05e4a-0e83-497a-a9be-54cabcf8986e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:20.918352 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c0b05e4a-0e83-497a-a9be-54cabcf8986e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:20.928331 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c0b05e4a-0e83-497a-a9be-54cabcf8986e tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 200 len: 1302 microversion: 2.1 time: 0.096087 Jan 28 01:03:20.929116 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 396/756] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:20 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:21.945850 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4c5438e3-fb4e-46e5-b41f-b7506983a28f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:21.946559 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4c5438e3-fb4e-46e5-b41f-b7506983a28f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: df026b29-203d-4492-892d-45774a906b25] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:21.953021 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4c5438e3-fb4e-46e5-b41f-b7506983a28f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:21.953478 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4c5438e3-fb4e-46e5-b41f-b7506983a28f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:21.954257 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4c5438e3-fb4e-46e5-b41f-b7506983a28f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:21.954697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4c5438e3-fb4e-46e5-b41f-b7506983a28f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:21.967913 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-4c5438e3-fb4e-46e5-b41f-b7506983a28f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] HTTP exception thrown: Instance df026b29-203d-4492-892d-45774a906b25 could not be found. Jan 28 01:03:21.968508 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4c5438e3-fb4e-46e5-b41f-b7506983a28f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Returning 404 to user: Instance df026b29-203d-4492-892d-45774a906b25 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:03:21.969336 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4c5438e3-fb4e-46e5-b41f-b7506983a28f tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25" status: 404 len: 111 microversion: 2.1 time: 0.027558 Jan 28 01:03:21.969881 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 361/757] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:21 2022] GET /compute/v2.1/servers/df026b29-203d-4492-892d-45774a906b25 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:03:22.214952 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-21447775-ce2f-4c9f-82f6-1e4729da8747 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:22.215527 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-21447775-ce2f-4c9f-82f6-1e4729da8747 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:22.221734 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-21447775-ce2f-4c9f-82f6-1e4729da8747 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:22.222182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-21447775-ce2f-4c9f-82f6-1e4729da8747 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:22.222982 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-21447775-ce2f-4c9f-82f6-1e4729da8747 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:22.223421 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-21447775-ce2f-4c9f-82f6-1e4729da8747 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:22.247299 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-21447775-ce2f-4c9f-82f6-1e4729da8747 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lazy-loading 'flavor' on Instance uuid 2bff9f97-2065-4e4e-8e55-28563a35288c {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:03:22.511714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-21447775-ce2f-4c9f-82f6-1e4729da8747 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 202 len: 0 microversion: 2.20 time: 0.300113 Jan 28 01:03:22.513010 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 397/758] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:22 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:03:22.520361 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:22.520996 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:22.533628 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:22.533628 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:22.533628 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:22.533628 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:22.672109 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:22.680315 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:22.681824 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:22.683023 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8d509a90-f322-4c49-974e-0ef6c9f26490 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.166493 Jan 28 01:03:22.683582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 362/759] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:22 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:23.098345 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e0caf3ce-cbd6-44c8-a6fe-58e079b5a651 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:23.098965 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e0caf3ce-cbd6-44c8-a6fe-58e079b5a651 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:23.105673 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e0caf3ce-cbd6-44c8-a6fe-58e079b5a651 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:23.106124 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e0caf3ce-cbd6-44c8-a6fe-58e079b5a651 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:23.106929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e0caf3ce-cbd6-44c8-a6fe-58e079b5a651 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:23.107367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e0caf3ce-cbd6-44c8-a6fe-58e079b5a651 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:23.130776 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e0caf3ce-cbd6-44c8-a6fe-58e079b5a651 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Going to try to terminate instance {{(pid=116254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:03:23.202499 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e0caf3ce-cbd6-44c8-a6fe-58e079b5a651 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "DELETE /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 204 len: 0 microversion: 2.1 time: 0.107912 Jan 28 01:03:23.203120 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 398/760] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:03:23 2022] DELETE /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:03:23.210907 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-018fe22f-3f37-4653-a092-33f84a81a2ad tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:23.211552 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-018fe22f-3f37-4653-a092-33f84a81a2ad tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:23.218475 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-018fe22f-3f37-4653-a092-33f84a81a2ad tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:23.218961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-018fe22f-3f37-4653-a092-33f84a81a2ad tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:23.219753 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-018fe22f-3f37-4653-a092-33f84a81a2ad tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:23.220194 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-018fe22f-3f37-4653-a092-33f84a81a2ad tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:23.349604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-018fe22f-3f37-4653-a092-33f84a81a2ad tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:23.357704 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-018fe22f-3f37-4653-a092-33f84a81a2ad tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1513 microversion: 2.1 time: 0.150541 Jan 28 01:03:23.358277 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 363/761] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:23 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:03:23.701745 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:23.702398 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:23.708565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:23.708990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:23.709778 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:23.710213 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:23.836468 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:23.844645 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:23.846130 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:23.847294 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-69d65094-ac83-47cc-bd8c-e12ba89573ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.149756 Jan 28 01:03:23.847854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 399/762] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:23 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:24.375576 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-152993b4-e132-412d-a04c-02d8c34f1b8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:24.376206 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-152993b4-e132-412d-a04c-02d8c34f1b8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:24.383024 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-152993b4-e132-412d-a04c-02d8c34f1b8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:24.383513 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-152993b4-e132-412d-a04c-02d8c34f1b8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:24.384318 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-152993b4-e132-412d-a04c-02d8c34f1b8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:24.384757 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-152993b4-e132-412d-a04c-02d8c34f1b8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:24.526144 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-152993b4-e132-412d-a04c-02d8c34f1b8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:24.533459 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-152993b4-e132-412d-a04c-02d8c34f1b8a tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1513 microversion: 2.1 time: 0.161694 Jan 28 01:03:24.534019 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 364/763] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:24 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:24.865748 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:24.866361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:24.873251 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:24.873707 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:24.874496 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:24.874958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:24.999018 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:25.006787 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:25.008363 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:25.009522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8db6c55c-52e0-42da-ba69-17298c648b64 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.147527 Jan 28 01:03:25.010081 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 400/764] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:24 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:25.549380 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-73095ee7-db31-433f-80c1-87e04edd3e98 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:25.550202 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-73095ee7-db31-433f-80c1-87e04edd3e98 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:25.556527 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-73095ee7-db31-433f-80c1-87e04edd3e98 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:25.557122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-73095ee7-db31-433f-80c1-87e04edd3e98 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:25.558050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-73095ee7-db31-433f-80c1-87e04edd3e98 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:25.558492 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-73095ee7-db31-433f-80c1-87e04edd3e98 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:25.690269 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-73095ee7-db31-433f-80c1-87e04edd3e98 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '957a7c1ed6e045fdb3252969ea163b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433c6f07b086479f94f16f5314942da7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:25.697571 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-73095ee7-db31-433f-80c1-87e04edd3e98 tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 200 len: 1513 microversion: 2.1 time: 0.151832 Jan 28 01:03:25.698514 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 365/765] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:25 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:25.793725 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-2fd7d73c-0d21-43d2-90eb-3737b818bde8 req-11c28917-4176-4cd5-9a61-176e14834fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19505ea2-2d12-47cf-9a5f-d5185a64ffc4", "name": "network-vif-deleted", "tag": "7ee19dba-7e3e-494c-881c-7d8ecc7fabdc"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:25.795442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:25.795442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:03:25.802713 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-2fd7d73c-0d21-43d2-90eb-3737b818bde8 req-11c28917-4176-4cd5-9a61-176e14834fa1 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:25.803196 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-2fd7d73c-0d21-43d2-90eb-3737b818bde8 req-11c28917-4176-4cd5-9a61-176e14834fa1 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:25.813850 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-2fd7d73c-0d21-43d2-90eb-3737b818bde8 req-11c28917-4176-4cd5-9a61-176e14834fa1 service nova] Creating event network-vif-deleted:7ee19dba-7e3e-494c-881c-7d8ecc7fabdc for instance 19505ea2-2d12-47cf-9a5f-d5185a64ffc4 on hv-cinder-81689 Jan 28 01:03:25.818573 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-2fd7d73c-0d21-43d2-90eb-3737b818bde8 req-11c28917-4176-4cd5-9a61-176e14834fa1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028409 Jan 28 01:03:25.819204 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 401/766] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:26.028196 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:26.028723 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:26.034600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:26.035088 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:26.035865 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:26.036302 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:26.163195 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:26.170803 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:26.172558 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:26.173711 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-650ea001-45a1-44a8-b892-71904bd56ad2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.150254 Jan 28 01:03:26.174268 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 366/767] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:26 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:26.715503 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-20198dbf-5763-4bfc-8a2d-84a9ea16babe tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:26.716215 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-20198dbf-5763-4bfc-8a2d-84a9ea16babe tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] [instance: 19505ea2-2d12-47cf-9a5f-d5185a64ffc4] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:26.722494 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-20198dbf-5763-4bfc-8a2d-84a9ea16babe tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:26.722980 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-20198dbf-5763-4bfc-8a2d-84a9ea16babe tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:26.723767 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-20198dbf-5763-4bfc-8a2d-84a9ea16babe tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:26.724205 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-20198dbf-5763-4bfc-8a2d-84a9ea16babe tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:26.739038 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-20198dbf-5763-4bfc-8a2d-84a9ea16babe tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] HTTP exception thrown: Instance 19505ea2-2d12-47cf-9a5f-d5185a64ffc4 could not be found. Jan 28 01:03:26.739621 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-20198dbf-5763-4bfc-8a2d-84a9ea16babe tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] Returning 404 to user: Instance 19505ea2-2d12-47cf-9a5f-d5185a64ffc4 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:03:26.740428 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-20198dbf-5763-4bfc-8a2d-84a9ea16babe tempest-AttachVolumeNegativeTest-1636178652 tempest-AttachVolumeNegativeTest-1636178652-project] 10.222.0.78 "GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4" status: 404 len: 111 microversion: 2.1 time: 0.029465 Jan 28 01:03:26.740981 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 402/768] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:26 2022] GET /compute/v2.1/servers/19505ea2-2d12-47cf-9a5f-d5185a64ffc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:03:27.191952 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:27.192565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:27.199435 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:27.199889 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:27.200671 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:27.201285 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:27.352380 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:27.360665 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:27.362167 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:27.363369 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-18a64fd0-7683-4125-81c2-8a1333f37b57 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.175205 Jan 28 01:03:27.363960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 367/769] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:27 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:28.381757 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:28.382633 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:28.389392 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:28.389852 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:28.390649 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:28.391124 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:28.525010 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:28.533221 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:28.534738 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:28.535938 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a25e7ecd-a8ba-468f-95f4-61bc85c7c261 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.157952 Jan 28 01:03:28.538918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 403/770] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:28 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:29.553334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:29.553956 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:29.560871 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:29.561329 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:29.562125 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:29.562569 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:29.715755 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:29.723609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:29.725125 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:29.726296 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-64c92c2e-99eb-4525-937d-a75f08f5d80f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.176730 Jan 28 01:03:29.726853 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 368/771] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:29 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:30.744212 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:30.744831 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:30.752555 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:30.753459 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:30.754809 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:30.755807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:30.894373 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:30.903072 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:30.904606 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:30.905829 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ea45b8cd-bad3-4c9e-bf3e-b0d6f75fccd7 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.165388 Jan 28 01:03:30.906380 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 404/772] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:30 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:31.922993 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:31.923600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:31.930479 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:31.931508 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:31.932551 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:31.933233 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:32.066336 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:32.074501 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:32.076044 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:32.077212 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d060814c-ca80-4448-b251-dc7287edd68d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.158112 Jan 28 01:03:32.077773 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 369/773] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:31 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:33.094953 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:33.095563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:33.101882 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:33.102374 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:33.103221 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:33.103653 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:33.235489 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:33.243266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:33.244774 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:33.245934 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-cd41204a-5259-4a53-a707-062f4ec133e1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1744 microversion: 2.20 time: 0.154930 Jan 28 01:03:33.246498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 405/774] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:33 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:34.264129 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:34.264752 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:34.271189 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:34.271649 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:34.272447 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:34.272887 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:34.434672 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:34.444520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:34.446773 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:34.448078 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6d13ea73-8e9a-47bd-8bbb-ce878d55c4bd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1744 microversion: 2.20 time: 0.187721 Jan 28 01:03:34.448721 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 370/775] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:34 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:35.467817 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:35.468601 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:35.475327 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:35.476035 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:35.477701 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:35.478224 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:35.649318 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:35.657934 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:35.659976 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:35.661799 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1c41e3f8-1126-41da-a9cb-4870f295a3b8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.197949 Jan 28 01:03:35.662364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 406/776] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:35 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:36.433218 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-e7ef397b-4103-42e7-b2f5-4007491d2e60 req-dfe095dd-3941-4956-a806-14f24c4dd8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff9f97-2065-4e4e-8e55-28563a35288c", "name": "network-vif-plugged", "status": "completed", "tag": "70dfd08a-1b60-4f24-ac93-be76036044f2"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:36.434810 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:36.434810 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:03:36.447580 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-e7ef397b-4103-42e7-b2f5-4007491d2e60 req-dfe095dd-3941-4956-a806-14f24c4dd8ac service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:36.448437 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-e7ef397b-4103-42e7-b2f5-4007491d2e60 req-dfe095dd-3941-4956-a806-14f24c4dd8ac service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:36.464372 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-e7ef397b-4103-42e7-b2f5-4007491d2e60 req-dfe095dd-3941-4956-a806-14f24c4dd8ac service nova] Creating event network-vif-plugged:70dfd08a-1b60-4f24-ac93-be76036044f2 for instance 2bff9f97-2065-4e4e-8e55-28563a35288c on hv-cinder-81689 Jan 28 01:03:36.472484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-e7ef397b-4103-42e7-b2f5-4007491d2e60 req-dfe095dd-3941-4956-a806-14f24c4dd8ac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289009 Jan 28 01:03:36.473586 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 371/777] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:36.689642 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:36.691030 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:36.700738 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:36.701253 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:36.702602 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:36.703283 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:36.910396 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:36.921177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:36.922830 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:36.924031 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-24e3502d-c2fb-44f9-9cb4-f550a2b9b607 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.247035 Jan 28 01:03:36.938325 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 407/778] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:36 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:37.950919 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:37.952742 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:37.961943 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:37.962669 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:37.963693 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:37.964304 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:38.126360 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:38.136160 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:38.138090 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:38.140195 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1891f36f-a866-4693-84ad-761ef6921a3e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.198857 Jan 28 01:03:38.141697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 372/779] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:37 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:39.160347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:39.161590 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:39.170056 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:39.170546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:39.171404 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:39.171831 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:39.329334 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:39.338650 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:39.340454 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:39.341895 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fc42159a-2157-4181-947f-3132337dc1f3 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.185428 Jan 28 01:03:39.342751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 408/780] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:39 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:40.366913 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:40.368314 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:40.375809 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:40.376276 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:40.377067 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:40.377505 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:40.542595 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:40.551134 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:40.552627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:40.553781 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-fddbe567-41de-4c6a-bc31-f1740eb2c799 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.192707 Jan 28 01:03:40.554348 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 373/781] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:40 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:41.574283 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:41.574974 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:41.581240 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:41.581706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:41.582500 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:41.582965 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:41.739565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:41.748381 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:41.750002 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:41.752526 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1c7222f0-50b8-4506-a64b-7200c631f5c8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.183416 Jan 28 01:03:41.753868 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 409/782] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:41 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:42.772632 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:42.774334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:42.780991 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:42.781515 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:42.782369 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:42.782920 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:42.946634 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:42.955026 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:42.956675 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:42.958054 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7c5d1782-0e68-4d6c-818a-765d0d9f9ebb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.189817 Jan 28 01:03:42.959168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 374/783] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:42 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:43.939188 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a71f7669-ae76-4c60-b8f7-0c9f0b75e6c5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1723141066"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:43.939882 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a71f7669-ae76-4c60-b8f7-0c9f0b75e6c5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:43.947226 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a71f7669-ae76-4c60-b8f7-0c9f0b75e6c5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:43.947769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a71f7669-ae76-4c60-b8f7-0c9f0b75e6c5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:43.948834 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a71f7669-ae76-4c60-b8f7-0c9f0b75e6c5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:43.949337 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a71f7669-ae76-4c60-b8f7-0c9f0b75e6c5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:43.978320 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:43.979199 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:43.990977 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:43.991438 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:43.993699 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:43.994267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:44.135405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.network.security_group_api [None req-a71f7669-ae76-4c60-b8f7-0c9f0b75e6c5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Removing security group 94b90060-95e9-4a09-b32d-92635b5508a3 from port aaf8455f-185c-4280-8718-72bf446c9dc1 Jan 28 01:03:44.154387 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:44.164481 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:44.166008 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:44.167219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b834a6d1-af38-40a2-ae80-7026f4253ba8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.193708 Jan 28 01:03:44.167786 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 375/784] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:43 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:03:44.540681 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a71f7669-ae76-4c60-b8f7-0c9f0b75e6c5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "POST /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/action" status: 202 len: 0 microversion: 2.1 time: 0.606161 Jan 28 01:03:44.541453 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 410/785] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:03:43 2022] POST /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:44.561405 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-705648d6-3d59-4913-834a-b948e04c6d29 req-f01c5a85-0d06-430a-90bb-a026baea39e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07b7f77-0d8d-444b-9cad-fed068cdafec", "tag": "aaf8455f-185c-4280-8718-72bf446c9dc1"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:44.563469 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:44.563469 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:03:44.574647 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-705648d6-3d59-4913-834a-b948e04c6d29 req-f01c5a85-0d06-430a-90bb-a026baea39e4 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:44.575376 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-705648d6-3d59-4913-834a-b948e04c6d29 req-f01c5a85-0d06-430a-90bb-a026baea39e4 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:44.595457 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-705648d6-3d59-4913-834a-b948e04c6d29 req-f01c5a85-0d06-430a-90bb-a026baea39e4 service nova] Creating event network-changed:aaf8455f-185c-4280-8718-72bf446c9dc1 for instance a07b7f77-0d8d-444b-9cad-fed068cdafec on hv-cinder-81689 Jan 28 01:03:44.603692 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-705648d6-3d59-4913-834a-b948e04c6d29 req-f01c5a85-0d06-430a-90bb-a026baea39e4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048532 Jan 28 01:03:44.607120 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 376/786] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:03:45.185762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:45.186589 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:45.192960 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:45.193413 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:45.194191 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:45.194625 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:45.430691 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:45.438614 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:45.440205 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:45.441361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7904ae68-438d-4a3e-9627-f4b023a2d093 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.259958 Jan 28 01:03:45.441917 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 411/787] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:45 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:45.902666 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c847833a-ee5f-4ab8-87f4-b521f3164281 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:45.903319 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c847833a-ee5f-4ab8-87f4-b521f3164281 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:45.909479 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c847833a-ee5f-4ab8-87f4-b521f3164281 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:45.909946 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c847833a-ee5f-4ab8-87f4-b521f3164281 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:45.910731 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c847833a-ee5f-4ab8-87f4-b521f3164281 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:45.911208 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c847833a-ee5f-4ab8-87f4-b521f3164281 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:45.992163 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-c847833a-ee5f-4ab8-87f4-b521f3164281 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lazy-loading 'services' on Instance uuid a07b7f77-0d8d-444b-9cad-fed068cdafec {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:03:46.069073 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c847833a-ee5f-4ab8-87f4-b521f3164281 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments/68014e04-f559-4b04-ab22-9a0b5cdbd209" status: 202 len: 0 microversion: 2.1 time: 0.171368 Jan 28 01:03:46.069972 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 377/788] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:03:45 2022] DELETE /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments/68014e04-f559-4b04-ab22-9a0b5cdbd209 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:46.079092 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-59eace69-395f-437c-ae59-8ae3746569d9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:46.079999 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-59eace69-395f-437c-ae59-8ae3746569d9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:46.086026 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59eace69-395f-437c-ae59-8ae3746569d9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:46.086520 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59eace69-395f-437c-ae59-8ae3746569d9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:46.087423 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59eace69-395f-437c-ae59-8ae3746569d9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:46.089928 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-59eace69-395f-437c-ae59-8ae3746569d9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:46.119739 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-59eace69-395f-437c-ae59-8ae3746569d9 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Jan 28 01:03:46.120475 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 412/789] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:03:46 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:46.461689 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:46.462491 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:46.469022 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:46.469571 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:46.470484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:46.471054 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:46.639220 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-1d2c8f06-21ae-4e51-8b9f-a9fc60736c33 req-c5024a5e-98a0-426a-86c5-9379477c3cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07b7f77-0d8d-444b-9cad-fed068cdafec", "tag": "aaf8455f-185c-4280-8718-72bf446c9dc1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:46.641990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:46.641990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:03:46.669834 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-1d2c8f06-21ae-4e51-8b9f-a9fc60736c33 req-c5024a5e-98a0-426a-86c5-9379477c3cb1 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:46.670293 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-1d2c8f06-21ae-4e51-8b9f-a9fc60736c33 req-c5024a5e-98a0-426a-86c5-9379477c3cb1 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:46.677179 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:46.699582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-1d2c8f06-21ae-4e51-8b9f-a9fc60736c33 req-c5024a5e-98a0-426a-86c5-9379477c3cb1 service nova] Creating event network-changed:aaf8455f-185c-4280-8718-72bf446c9dc1 for instance a07b7f77-0d8d-444b-9cad-fed068cdafec on hv-cinder-81689 Jan 28 01:03:46.709842 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:46.712048 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-1d2c8f06-21ae-4e51-8b9f-a9fc60736c33 req-c5024a5e-98a0-426a-86c5-9379477c3cb1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080785 Jan 28 01:03:46.713550 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:46.716904 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 413/790] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:46.719149 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-dd665a6d-8f4a-4c7e-b04d-8d7c6c7db7d8 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1739 microversion: 2.20 time: 0.262343 Jan 28 01:03:46.721081 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 378/791] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:46 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:47.132138 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a5570c6c-5820-4f93-a197-d4507cc051df tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:47.133191 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a5570c6c-5820-4f93-a197-d4507cc051df tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:47.140363 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a5570c6c-5820-4f93-a197-d4507cc051df tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:47.141058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a5570c6c-5820-4f93-a197-d4507cc051df tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:47.142066 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a5570c6c-5820-4f93-a197-d4507cc051df tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:47.142739 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a5570c6c-5820-4f93-a197-d4507cc051df tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:47.173023 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a5570c6c-5820-4f93-a197-d4507cc051df tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Jan 28 01:03:47.173608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 414/792] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:03:47 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:03:47.739474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:47.740739 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:47.748197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:47.748651 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:47.749448 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:47.750061 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:48.017914 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:48.037424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:48.041580 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:48.044921 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a672b016-607c-4bba-8955-7e3f6f36cabd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1721 microversion: 2.20 time: 0.308644 Jan 28 01:03:48.049097 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 379/793] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:47 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:48.185431 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-421e6201-7b10-4b0f-b106-9bd9d7f217e7 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:48.186375 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-421e6201-7b10-4b0f-b106-9bd9d7f217e7 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:48.192766 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-421e6201-7b10-4b0f-b106-9bd9d7f217e7 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:48.193223 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-421e6201-7b10-4b0f-b106-9bd9d7f217e7 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:48.194013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-421e6201-7b10-4b0f-b106-9bd9d7f217e7 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:48.194460 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-421e6201-7b10-4b0f-b106-9bd9d7f217e7 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:48.223084 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-421e6201-7b10-4b0f-b106-9bd9d7f217e7 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041284 Jan 28 01:03:48.223647 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 415/794] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:03:48 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:03:48.233735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a17953d2-0002-4ba6-90b2-805259c63fe8 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:48.234240 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a17953d2-0002-4ba6-90b2-805259c63fe8 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:48.240495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a17953d2-0002-4ba6-90b2-805259c63fe8 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:48.240952 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a17953d2-0002-4ba6-90b2-805259c63fe8 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:48.241730 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a17953d2-0002-4ba6-90b2-805259c63fe8 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:48.242168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a17953d2-0002-4ba6-90b2-805259c63fe8 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:48.314905 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-a17953d2-0002-4ba6-90b2-805259c63fe8 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] HTTP exception thrown: Instance a07b7f77-0d8d-444b-9cad-fed068cdafec is not attached to volume 68014e04-f559-4b04-ab22-9a0b5cdbd209 Jan 28 01:03:48.315529 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a17953d2-0002-4ba6-90b2-805259c63fe8 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Returning 404 to user: Instance a07b7f77-0d8d-444b-9cad-fed068cdafec is not attached to volume 68014e04-f559-4b04-ab22-9a0b5cdbd209 {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:03:48.316373 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a17953d2-0002-4ba6-90b2-805259c63fe8 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments/68014e04-f559-4b04-ab22-9a0b5cdbd209" status: 404 len: 154 microversion: 2.1 time: 0.086488 Jan 28 01:03:48.316930 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 380/795] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:03:48 2022] DELETE /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec/os-volume_attachments/68014e04-f559-4b04-ab22-9a0b5cdbd209 => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:03:49.069654 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:49.070260 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:49.078857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:49.078857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:49.079317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:49.079935 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:49.256706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:49.264749 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:49.266301 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:49.267523 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0379cfd6-b257-4044-be77-a72f4ea8d797 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1721 microversion: 2.20 time: 0.201616 Jan 28 01:03:49.268456 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 416/796] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:49 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:49.443861 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9e6b0e2d-b5f4-40a8-9709-14c2c360b9b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:49.444410 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9e6b0e2d-b5f4-40a8-9709-14c2c360b9b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:49.451622 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9e6b0e2d-b5f4-40a8-9709-14c2c360b9b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:49.452078 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9e6b0e2d-b5f4-40a8-9709-14c2c360b9b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:49.452872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9e6b0e2d-b5f4-40a8-9709-14c2c360b9b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:49.453315 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9e6b0e2d-b5f4-40a8-9709-14c2c360b9b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:49.477781 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9e6b0e2d-b5f4-40a8-9709-14c2c360b9b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:03:49.553161 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9e6b0e2d-b5f4-40a8-9709-14c2c360b9b5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 204 len: 0 microversion: 2.1 time: 0.112570 Jan 28 01:03:49.553703 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 381/797] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:03:49 2022] DELETE /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:03:49.562773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a3e201a1-a49a-4d9e-b446-ece1c231dc41 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:49.563435 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a3e201a1-a49a-4d9e-b446-ece1c231dc41 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:49.569600 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a3e201a1-a49a-4d9e-b446-ece1c231dc41 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:49.570050 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a3e201a1-a49a-4d9e-b446-ece1c231dc41 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:49.571433 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a3e201a1-a49a-4d9e-b446-ece1c231dc41 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:49.571872 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a3e201a1-a49a-4d9e-b446-ece1c231dc41 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:49.699557 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a3e201a1-a49a-4d9e-b446-ece1c231dc41 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:49.706914 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a3e201a1-a49a-4d9e-b446-ece1c231dc41 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1554 microversion: 2.1 time: 0.147799 Jan 28 01:03:49.707484 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 417/798] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:49 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:50.285908 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:50.286596 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:50.293326 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:50.293789 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:50.294579 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:50.295050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:50.434040 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:50.442084 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:50.443631 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:50.445320 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b18e9b71-14d3-4fff-a37a-5a8c04f0db33 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1721 microversion: 2.20 time: 0.163396 Jan 28 01:03:50.446541 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 382/799] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:50 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:50.729166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-cf860806-38db-4e03-b11b-da4e486a0093 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:50.729772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-cf860806-38db-4e03-b11b-da4e486a0093 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:50.736078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cf860806-38db-4e03-b11b-da4e486a0093 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:50.736522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cf860806-38db-4e03-b11b-da4e486a0093 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:50.737314 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cf860806-38db-4e03-b11b-da4e486a0093 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:50.737750 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cf860806-38db-4e03-b11b-da4e486a0093 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:50.872775 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-cf860806-38db-4e03-b11b-da4e486a0093 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:50.880333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-cf860806-38db-4e03-b11b-da4e486a0093 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1554 microversion: 2.1 time: 0.154848 Jan 28 01:03:50.880908 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 418/800] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:50 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:51.365574 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-71dfc2a6-71dc-4a81-b6d7-77dadfc3bc86 req-30396c0d-e356-4b6a-a833-958d8edbd667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff9f97-2065-4e4e-8e55-28563a35288c", "name": "network-vif-unplugged", "status": "completed", "tag": "70dfd08a-1b60-4f24-ac93-be76036044f2"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:51.367166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:51.367166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:03:51.375575 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-71dfc2a6-71dc-4a81-b6d7-77dadfc3bc86 req-30396c0d-e356-4b6a-a833-958d8edbd667 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:51.376048 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-71dfc2a6-71dc-4a81-b6d7-77dadfc3bc86 req-30396c0d-e356-4b6a-a833-958d8edbd667 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:51.388929 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-71dfc2a6-71dc-4a81-b6d7-77dadfc3bc86 req-30396c0d-e356-4b6a-a833-958d8edbd667 service nova] Creating event network-vif-unplugged:70dfd08a-1b60-4f24-ac93-be76036044f2 for instance 2bff9f97-2065-4e4e-8e55-28563a35288c on hv-cinder-81689 Jan 28 01:03:51.393210 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-71dfc2a6-71dc-4a81-b6d7-77dadfc3bc86 req-30396c0d-e356-4b6a-a833-958d8edbd667 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031138 Jan 28 01:03:51.393827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 383/801] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:51.464543 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:51.465149 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:51.471281 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:51.471731 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:51.472512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:51.472951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:51.609575 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:51.617404 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:51.618924 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:51.620075 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-36d2c647-9f2e-46d1-bfaa-614176b37307 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1721 microversion: 2.20 time: 0.159799 Jan 28 01:03:51.620634 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 419/802] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:51 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:51.897956 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-00996c5d-8a5c-4d4b-952a-678724a2e4a5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:51.898609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-00996c5d-8a5c-4d4b-952a-678724a2e4a5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:51.904987 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-00996c5d-8a5c-4d4b-952a-678724a2e4a5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:51.905439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-00996c5d-8a5c-4d4b-952a-678724a2e4a5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:51.906224 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-00996c5d-8a5c-4d4b-952a-678724a2e4a5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:51.907301 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-00996c5d-8a5c-4d4b-952a-678724a2e4a5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:52.036263 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-00996c5d-8a5c-4d4b-952a-678724a2e4a5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:52.043679 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-00996c5d-8a5c-4d4b-952a-678724a2e4a5 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1554 microversion: 2.1 time: 0.149865 Jan 28 01:03:52.044248 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 384/803] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:51 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:52.638593 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:52.639141 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:52.645483 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:52.645940 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:52.646721 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:52.647187 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:52.780932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:52.789752 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:52.791294 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:52.792467 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8e2cb224-cdf7-4518-b33b-06d939694dcb tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1721 microversion: 2.20 time: 0.157730 Jan 28 01:03:52.793027 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 420/804] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:52 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:53.061329 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6839cbf6-c091-4da1-8d6d-718db6be0a87 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:53.062067 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6839cbf6-c091-4da1-8d6d-718db6be0a87 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:53.068584 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6839cbf6-c091-4da1-8d6d-718db6be0a87 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:53.069044 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6839cbf6-c091-4da1-8d6d-718db6be0a87 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:53.069849 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6839cbf6-c091-4da1-8d6d-718db6be0a87 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:53.070292 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6839cbf6-c091-4da1-8d6d-718db6be0a87 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:53.435406 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6839cbf6-c091-4da1-8d6d-718db6be0a87 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:53.443150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6839cbf6-c091-4da1-8d6d-718db6be0a87 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1554 microversion: 2.1 time: 0.385500 Jan 28 01:03:53.444033 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 385/805] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:53 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1554 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:53.810983 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:53.811573 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:53.818354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:53.818809 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:53.819627 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:53.820071 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:53.954017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:53.962139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:53.963664 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:53.964816 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5b9a3c25-dfeb-4735-b466-7f249d0e3adc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1664 microversion: 2.20 time: 0.157700 Jan 28 01:03:53.965373 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 421/806] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:53 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:03:53.981805 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-022c91b6-29c6-4862-8b34-73a7df6c23ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5623ac0-5071-4997-993c-c239f5ab1e04"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:53.982939 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-022c91b6-29c6-4862-8b34-73a7df6c23ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:53.990321 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-022c91b6-29c6-4862-8b34-73a7df6c23ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:53.990778 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-022c91b6-29c6-4862-8b34-73a7df6c23ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:53.991600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-022c91b6-29c6-4862-8b34-73a7df6c23ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:53.992052 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-022c91b6-29c6-4862-8b34-73a7df6c23ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:54.262521 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-022c91b6-29c6-4862-8b34-73a7df6c23ff tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.284263 Jan 28 01:03:54.263893 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 386/807] 10.222.0.78 () {62 vars in 1363 bytes} [Fri Jan 28 01:03:53 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:03:54.389519 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3ac73ac8-a1f3-4020-b88c-da6a92740a02 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:54.390033 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3ac73ac8-a1f3-4020-b88c-da6a92740a02 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:54.396027 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3ac73ac8-a1f3-4020-b88c-da6a92740a02 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:54.396474 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3ac73ac8-a1f3-4020-b88c-da6a92740a02 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:54.397248 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3ac73ac8-a1f3-4020-b88c-da6a92740a02 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:54.397686 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3ac73ac8-a1f3-4020-b88c-da6a92740a02 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:54.461542 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-75ae4ff9-5a29-4c97-b762-c19bdd20be75 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:54.462199 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-75ae4ff9-5a29-4c97-b762-c19bdd20be75 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:54.468822 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-75ae4ff9-5a29-4c97-b762-c19bdd20be75 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:54.469282 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-75ae4ff9-5a29-4c97-b762-c19bdd20be75 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:54.470179 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-75ae4ff9-5a29-4c97-b762-c19bdd20be75 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:54.470624 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-75ae4ff9-5a29-4c97-b762-c19bdd20be75 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:54.654850 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3ac73ac8-a1f3-4020-b88c-da6a92740a02 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/os-volume_attachments/d5623ac0-5071-4997-993c-c239f5ab1e04" status: 202 len: 0 microversion: 2.20 time: 0.268920 Jan 28 01:03:54.655548 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 422/808] 10.222.0.78 () {60 vars in 1456 bytes} [Fri Jan 28 01:03:54 2022] DELETE /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/os-volume_attachments/d5623ac0-5071-4997-993c-c239f5ab1e04 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 01:03:54.715472 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-75ae4ff9-5a29-4c97-b762-c19bdd20be75 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:54.728419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-75ae4ff9-5a29-4c97-b762-c19bdd20be75 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1554 microversion: 2.1 time: 0.270905 Jan 28 01:03:54.729748 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 387/809] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:54 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1554 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:03:54.731584 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3b9b2829-fbf7-49e5-902a-48d6125a7197 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:54.732549 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3b9b2829-fbf7-49e5-902a-48d6125a7197 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:54.743760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b9b2829-fbf7-49e5-902a-48d6125a7197 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:54.744436 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b9b2829-fbf7-49e5-902a-48d6125a7197 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:54.745381 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b9b2829-fbf7-49e5-902a-48d6125a7197 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:54.746084 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b9b2829-fbf7-49e5-902a-48d6125a7197 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:54.954676 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3b9b2829-fbf7-49e5-902a-48d6125a7197 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action" status: 202 len: 0 microversion: 2.20 time: 0.230507 Jan 28 01:03:54.958619 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 423/810] 10.222.0.78 () {62 vars in 1318 bytes} [Fri Jan 28 01:03:54 2022] POST /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 01:03:54.963602 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:54.964223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:54.972947 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:54.973688 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:54.974735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:54.975550 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:55.242846 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:55.252609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:55.254298 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:55.255511 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-10f45cc7-50de-45ae-9e37-99f6ea3792d6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1672 microversion: 2.20 time: 0.296160 Jan 28 01:03:55.256069 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 388/811] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:54 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1672 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:55.345894 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-3d0f2f04-98a1-4b1d-a541-54d1bce76996 req-b41d36f8-63e4-47e7-b0b1-4c2f83328a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07b7f77-0d8d-444b-9cad-fed068cdafec", "name": "network-vif-deleted", "tag": "aaf8455f-185c-4280-8718-72bf446c9dc1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:55.347499 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:55.347499 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:03:55.355051 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-3d0f2f04-98a1-4b1d-a541-54d1bce76996 req-b41d36f8-63e4-47e7-b0b1-4c2f83328a55 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:55.355499 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-3d0f2f04-98a1-4b1d-a541-54d1bce76996 req-b41d36f8-63e4-47e7-b0b1-4c2f83328a55 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:55.367137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-3d0f2f04-98a1-4b1d-a541-54d1bce76996 req-b41d36f8-63e4-47e7-b0b1-4c2f83328a55 service nova] Creating event network-vif-deleted:aaf8455f-185c-4280-8718-72bf446c9dc1 for instance a07b7f77-0d8d-444b-9cad-fed068cdafec on hv-cinder-81689 Jan 28 01:03:55.372255 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-3d0f2f04-98a1-4b1d-a541-54d1bce76996 req-b41d36f8-63e4-47e7-b0b1-4c2f83328a55 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169772 Jan 28 01:03:55.372785 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 424/812] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:03:55.745467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-57654959-9750-4f7c-b55c-a41942856dc4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:55.746022 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-57654959-9750-4f7c-b55c-a41942856dc4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:55.752243 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-57654959-9750-4f7c-b55c-a41942856dc4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:55.752698 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-57654959-9750-4f7c-b55c-a41942856dc4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:55.753543 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-57654959-9750-4f7c-b55c-a41942856dc4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:55.753927 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-57654959-9750-4f7c-b55c-a41942856dc4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:55.814718 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-57654959-9750-4f7c-b55c-a41942856dc4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:55.822824 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-57654959-9750-4f7c-b55c-a41942856dc4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1512 microversion: 2.1 time: 0.081109 Jan 28 01:03:55.823277 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 389/813] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:55 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1512 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:56.276166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:56.276800 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:56.283305 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:56.283829 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:56.284529 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:56.284961 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:56.416608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:56.424702 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:56.426200 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:56.427388 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-062f63d5-475a-463a-a8d0-25705b9d590d tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1672 microversion: 2.20 time: 0.156248 Jan 28 01:03:56.427949 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 425/814] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:56 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:56.840128 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cb03d620-b346-45fc-8a92-dd5b2c95f732 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:56.840778 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cb03d620-b346-45fc-8a92-dd5b2c95f732 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:56.847266 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb03d620-b346-45fc-8a92-dd5b2c95f732 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:56.847723 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb03d620-b346-45fc-8a92-dd5b2c95f732 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:56.848513 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb03d620-b346-45fc-8a92-dd5b2c95f732 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:56.848960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb03d620-b346-45fc-8a92-dd5b2c95f732 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:56.909279 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-cb03d620-b346-45fc-8a92-dd5b2c95f732 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:56.920806 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cb03d620-b346-45fc-8a92-dd5b2c95f732 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1343 microversion: 2.1 time: 0.084534 Jan 28 01:03:56.921750 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 390/815] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:56 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1343 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:57.446852 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:57.447481 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:57.453944 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:57.454392 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:57.455210 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:57.455646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:57.595031 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:57.603604 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:57.605943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:57.607744 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-796a1dae-cdc8-4447-a125-c68287feef67 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1672 microversion: 2.20 time: 0.165239 Jan 28 01:03:57.619118 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 426/816] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:57 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:57.945646 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:57.946513 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:57.954936 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:57.955384 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:57.956199 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:57.956651 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:57.990176 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:57.990716 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:57.991254 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lazy-loading 'fault' on Instance uuid a07b7f77-0d8d-444b-9cad-fed068cdafec {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:03:58.032952 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939861de833b40df9d98e0e090cbb85a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43c3f3031ee40508283209d12740ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:58.041179 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0513ae9b-0fda-49fb-a1ed-7a3bc3aee7c4 tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 200 len: 1348 microversion: 2.1 time: 0.099638 Jan 28 01:03:58.042400 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 391/817] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:57 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:58.627770 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:58.628386 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:58.635323 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:58.635777 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:58.636687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:58.637021 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:58.774525 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:58.782661 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:58.784384 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:58.785539 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2275b667-b242-4c60-9427-d6dacae17d97 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.161554 Jan 28 01:03:58.786093 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 427/818] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:58 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:03:59.067627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cc363679-252e-45a8-b927-4f053c23ce2d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:59.068256 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cc363679-252e-45a8-b927-4f053c23ce2d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] [instance: a07b7f77-0d8d-444b-9cad-fed068cdafec] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:59.075742 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cc363679-252e-45a8-b927-4f053c23ce2d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:59.076207 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cc363679-252e-45a8-b927-4f053c23ce2d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:59.077089 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cc363679-252e-45a8-b927-4f053c23ce2d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:59.077540 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cc363679-252e-45a8-b927-4f053c23ce2d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:59.093811 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-cc363679-252e-45a8-b927-4f053c23ce2d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] HTTP exception thrown: Instance a07b7f77-0d8d-444b-9cad-fed068cdafec could not be found. Jan 28 01:03:59.094422 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cc363679-252e-45a8-b927-4f053c23ce2d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Returning 404 to user: Instance a07b7f77-0d8d-444b-9cad-fed068cdafec could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:03:59.095461 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cc363679-252e-45a8-b927-4f053c23ce2d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec" status: 404 len: 111 microversion: 2.1 time: 0.034052 Jan 28 01:03:59.096122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 392/819] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:59 2022] GET /compute/v2.1/servers/a07b7f77-0d8d-444b-9cad-fed068cdafec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:03:59.105085 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e939c877-fa3c-4bbf-9337-beab96657c1d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] Calling method '.version_select at 0x7f1a094175e0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:59.136077 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e939c877-fa3c-4bbf-9337-beab96657c1d tempest-TestMinimumBasicScenario-373529046 tempest-TestMinimumBasicScenario-373529046-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-633210491" status: 202 len: 0 microversion: 2.1 time: 0.035330 Jan 28 01:03:59.136669 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 428/820] 10.222.0.78 () {58 vars in 1268 bytes} [Fri Jan 28 01:03:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-633210491 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:59.809836 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:59.811041 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:59.821419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:59.822622 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:59.823943 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:59.824585 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:00.030725 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:00.047081 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:00.049170 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:00.050564 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-818eefbc-e897-445a-afd4-3ed634b9e85a tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.249970 Jan 28 01:04:00.061917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 393/821] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:03:59 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:01.083158 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:01.083847 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:01.102125 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:01.107309 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:01.108326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:01.108943 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:01.395546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:01.410172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:01.411973 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:01.413315 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-19c5696e-ea66-4c14-990f-955bde118182 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.338085 Jan 28 01:04:01.425976 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 429/822] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:01 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:02.433840 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:02.435141 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:02.446239 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:02.448473 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:02.449520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:02.451426 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:02.618155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:02.641424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:02.645341 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:02.648334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8d6c7432-47bd-4d79-93b1-b96f23a258fd tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.217748 Jan 28 01:04:02.650564 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 394/823] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:02 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:03.667598 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:03.669042 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:03.678289 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:03.684362 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:03.689355 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:03.689971 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:04.024062 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:04.042031 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:04.052333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:04.055725 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-bddb689b-4976-464f-980f-7b59428192bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.390172 Jan 28 01:04:04.056651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 430/824] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:03 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:05.073577 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:05.075796 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:05.094166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:05.094607 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:05.095631 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:05.096236 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:05.426616 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:05.446564 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:05.448515 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:05.453034 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c34ee581-ce57-4e72-a3ce-a54ef3c244ba tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.383169 Jan 28 01:04:05.453771 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 395/825] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:05 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:06.471435 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:06.472059 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:06.485133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:06.485587 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:06.486822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:06.490446 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:07.069076 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:07.088523 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:07.091085 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:07.092771 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0cc970a0-81a8-461f-af53-5d9ae115de1b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.625440 Jan 28 01:04:07.093795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 431/826] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:06 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:08.124950 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:08.125578 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:08.134561 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:08.135545 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:08.136573 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:08.137228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:08.378388 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:08.388255 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:08.390638 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:08.392382 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-97fbdd44-444c-4fbe-9089-0bb65be25c5f tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.276639 Jan 28 01:04:08.398780 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 396/827] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:08 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:09.410555 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:09.411258 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:09.419913 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:09.420313 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:09.421119 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:09.421556 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:09.585813 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:09.593823 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:09.595565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:09.596693 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e44f0b4e-2215-41de-bccf-9753da61b114 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.189805 Jan 28 01:04:09.597425 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 432/828] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:09 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:10.616303 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:10.617704 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:10.625352 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:10.625816 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:10.627411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:10.628035 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:10.792091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:10.801645 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:10.805710 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:10.807786 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e0476955-fe4b-4aa8-bbe1-1ee53fcfd45c tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.194976 Jan 28 01:04:10.808714 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 397/829] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:10 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:11.831955 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:11.832863 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:11.845316 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:11.846055 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:11.847225 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:11.847662 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:12.093869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:12.103874 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:12.105527 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:12.107067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d900fddb-d54c-4636-8f70-cba43f0ef9b0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.279306 Jan 28 01:04:12.118524 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 433/830] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:11 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:12.821432 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-e614677a-e07b-4b8c-abbd-9dfb8ac9468c req-7398a202-02fd-4a5d-bee0-210fc7b82d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff9f97-2065-4e4e-8e55-28563a35288c", "name": "network-vif-plugged", "status": "completed", "tag": "70dfd08a-1b60-4f24-ac93-be76036044f2"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:04:12.823947 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:04:12.823947 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:04:12.834520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-e614677a-e07b-4b8c-abbd-9dfb8ac9468c req-7398a202-02fd-4a5d-bee0-210fc7b82d3b service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:12.834997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-e614677a-e07b-4b8c-abbd-9dfb8ac9468c req-7398a202-02fd-4a5d-bee0-210fc7b82d3b service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:12.848215 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-e614677a-e07b-4b8c-abbd-9dfb8ac9468c req-7398a202-02fd-4a5d-bee0-210fc7b82d3b service nova] Creating event network-vif-plugged:70dfd08a-1b60-4f24-ac93-be76036044f2 for instance 2bff9f97-2065-4e4e-8e55-28563a35288c on hv-cinder-81689 Jan 28 01:04:12.855301 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-e614677a-e07b-4b8c-abbd-9dfb8ac9468c req-7398a202-02fd-4a5d-bee0-210fc7b82d3b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039022 Jan 28 01:04:12.855913 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 398/831] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:04:13.125621 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:13.126166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:13.133117 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:13.133570 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:13.134623 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:13.134807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:13.440996 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:13.456797 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:13.459262 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:13.460835 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e00a24b3-da28-4bcf-a1b2-063852e522bc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.339124 Jan 28 01:04:13.471989 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 434/832] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:13 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:14.483462 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:14.484177 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:14.492675 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:14.493439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:14.494245 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:14.494867 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:15.059165 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:15.067981 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:15.069837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:15.071774 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-98b74571-2965-46eb-9bf8-ca735343b43e tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.595881 Jan 28 01:04:15.072353 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 399/833] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:14 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:16.090228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:16.090870 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:16.099158 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:16.100096 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:16.101358 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:16.101907 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:16.253862 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:16.262796 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:16.264783 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:16.266445 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f996917b-2298-455d-a80e-0a7299c7b8a6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.180432 Jan 28 01:04:16.267056 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 435/834] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:16 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:17.289158 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:17.290545 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:17.309400 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:17.309858 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:17.311082 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:17.311536 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:17.653544 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:17.663066 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:17.671293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:17.672560 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b3103b10-142a-4091-8f94-3a047f72af0b tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1730 microversion: 2.20 time: 0.387681 Jan 28 01:04:17.684323 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 400/835] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:17 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1730 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:18.691424 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:18.692352 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:18.717487 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:18.722491 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:18.723845 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:18.724298 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:18.911613 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:18.921097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:18.922673 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:18.924061 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1c388c18-16fb-40d6-bb81-fe125f6b5c81 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1717 microversion: 2.20 time: 0.236822 Jan 28 01:04:18.939011 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 436/836] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:04:18 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1717 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:04:21.587834 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2c9a9b24-dfd2-4283-9ac4-09d2184865e3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Action: 'create', calling method: .version_select at 0x7f1a091c89d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1017196631"}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:04:21.606713 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-2c9a9b24-dfd2-4283-9ac4-09d2184865e3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'key_pairs'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:04:21.611234 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-2c9a9b24-dfd2-4283-9ac4-09d2184865e3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for user 38bed71713534d0999a15ea8440717a5 and project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'key_pairs'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:04:21.625193 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c9a9b24-dfd2-4283-9ac4-09d2184865e3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [6afdc9e3-9747-42b0-bd3b-96fec0c988c9] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 28 01:04:22.634997 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c9a9b24-dfd2-4283-9ac4-09d2184865e3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [6afdc9e3-9747-42b0-bd3b-96fec0c988c9] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 36696. Jan 28 01:04:22.913963 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-2c9a9b24-dfd2-4283-9ac4-09d2184865e3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'key_pairs'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:04:22.923906 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-2c9a9b24-dfd2-4283-9ac4-09d2184865e3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for user 38bed71713534d0999a15ea8440717a5 and project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'key_pairs'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:04:22.938224 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2c9a9b24-dfd2-4283-9ac4-09d2184865e3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 1.577114 Jan 28 01:04:22.939155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 401/837] 10.222.0.78 () {60 vars in 1157 bytes} [Fri Jan 28 01:04:21 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:04:49.744249 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1084674908", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1017196631", "security_groups": [{"name": "tempest-secgroup-smoke-1597946477"}], "block_device_mapping_v2": [{"uuid": "f197dcee-dc4e-40ba-8206-6c3cdf2b9640", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bb0bc5c-1a8f-440b-a693-6e8a7b68363c"}]}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:04:49.852651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] validate_networks() for [('3bb0bc5c-1a8f-440b-a693-6e8a7b68363c', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:04:50.208882 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:04:50.209309 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:04:50.209837 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:04:50.210238 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:04:50.210644 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:04:50.219746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:50.220192 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:50.220997 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:50.221431 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:50.238859 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:04:50.243441 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for user 38bed71713534d0999a15ea8440717a5 and project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:04:50.298465 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:04:50.300623 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f197dcee-dc4e-40ba-8206-6c3cdf2b9640',volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:04:50.428797 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5016eb56-82fb-42ab-bb62-e9efc8f6b3ce tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688161 Jan 28 01:04:50.429964 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 437/838] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:04:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:04:50.440290 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-514e9b58-efcf-4ad7-99de-479408a2ddfb tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:50.440987 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-514e9b58-efcf-4ad7-99de-479408a2ddfb tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:50.494866 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-514e9b58-efcf-4ad7-99de-479408a2ddfb tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:50.501741 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-514e9b58-efcf-4ad7-99de-479408a2ddfb tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1095 microversion: 2.1 time: 0.065700 Jan 28 01:04:50.502549 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 402/839] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:04:50 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:04:51.518955 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7f31801d-08c1-4ae2-9fdc-dec810585bca tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:51.519517 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7f31801d-08c1-4ae2-9fdc-dec810585bca tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:51.526454 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7f31801d-08c1-4ae2-9fdc-dec810585bca tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:51.527188 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7f31801d-08c1-4ae2-9fdc-dec810585bca tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:51.527973 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7f31801d-08c1-4ae2-9fdc-dec810585bca tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:51.528414 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7f31801d-08c1-4ae2-9fdc-dec810585bca tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:51.588072 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7f31801d-08c1-4ae2-9fdc-dec810585bca tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:51.595206 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7f31801d-08c1-4ae2-9fdc-dec810585bca tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1201 microversion: 2.1 time: 0.079998 Jan 28 01:04:51.595763 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 438/840] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:04:51 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1201 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:04:52.612872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3d289fa9-7af0-40aa-8330-07e379ed7075 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:52.613484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3d289fa9-7af0-40aa-8330-07e379ed7075 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:52.620347 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3d289fa9-7af0-40aa-8330-07e379ed7075 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:52.620798 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3d289fa9-7af0-40aa-8330-07e379ed7075 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:52.621573 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3d289fa9-7af0-40aa-8330-07e379ed7075 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:52.622008 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3d289fa9-7af0-40aa-8330-07e379ed7075 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:52.680331 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3d289fa9-7af0-40aa-8330-07e379ed7075 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:52.687757 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3d289fa9-7af0-40aa-8330-07e379ed7075 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1201 microversion: 2.1 time: 0.078527 Jan 28 01:04:52.688318 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 403/841] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:04:52 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1201 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:04:53.703885 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-68056fb0-6763-4fc0-aaaa-461e84e67622 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:53.704447 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-68056fb0-6763-4fc0-aaaa-461e84e67622 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:53.710792 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-68056fb0-6763-4fc0-aaaa-461e84e67622 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:53.711312 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-68056fb0-6763-4fc0-aaaa-461e84e67622 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:53.712083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-68056fb0-6763-4fc0-aaaa-461e84e67622 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:53.712517 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-68056fb0-6763-4fc0-aaaa-461e84e67622 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:53.774137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-68056fb0-6763-4fc0-aaaa-461e84e67622 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:53.781975 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-68056fb0-6763-4fc0-aaaa-461e84e67622 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1201 microversion: 2.1 time: 0.081776 Jan 28 01:04:53.782554 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 439/842] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:04:53 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1201 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:04:54.798778 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1c16a105-874b-445c-a9ed-ca62263d9d25 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:54.800018 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1c16a105-874b-445c-a9ed-ca62263d9d25 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:54.807405 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1c16a105-874b-445c-a9ed-ca62263d9d25 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:54.807870 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1c16a105-874b-445c-a9ed-ca62263d9d25 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:54.808685 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1c16a105-874b-445c-a9ed-ca62263d9d25 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:54.809133 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1c16a105-874b-445c-a9ed-ca62263d9d25 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:55.299694 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1c16a105-874b-445c-a9ed-ca62263d9d25 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:55.307647 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1c16a105-874b-445c-a9ed-ca62263d9d25 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1279 microversion: 2.1 time: 0.512526 Jan 28 01:04:55.308227 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 404/843] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:04:54 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1279 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:04:55.689485 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-a5fb92d2-1881-46a4-a968-90d035953697 req-164823f8-10cc-4bc8-8dc5-703c433cef49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd", "tag": "0358ec0e-3460-4353-ba22-1ecfe9abe10c"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:04:55.691195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:04:55.691195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:04:55.701726 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-a5fb92d2-1881-46a4-a968-90d035953697 req-164823f8-10cc-4bc8-8dc5-703c433cef49 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:55.702223 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-a5fb92d2-1881-46a4-a968-90d035953697 req-164823f8-10cc-4bc8-8dc5-703c433cef49 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:55.719190 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-a5fb92d2-1881-46a4-a968-90d035953697 req-164823f8-10cc-4bc8-8dc5-703c433cef49 service nova] Creating event network-changed:0358ec0e-3460-4353-ba22-1ecfe9abe10c for instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd on hv-cinder-81689 Jan 28 01:04:55.724656 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-a5fb92d2-1881-46a4-a968-90d035953697 req-164823f8-10cc-4bc8-8dc5-703c433cef49 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047006 Jan 28 01:04:55.725290 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 440/844] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:04:56.325177 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ac3d3757-3eaf-4de0-865f-29e3a5db9bc0 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:56.325941 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ac3d3757-3eaf-4de0-865f-29e3a5db9bc0 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:56.332505 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ac3d3757-3eaf-4de0-865f-29e3a5db9bc0 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:56.333040 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ac3d3757-3eaf-4de0-865f-29e3a5db9bc0 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:56.333835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ac3d3757-3eaf-4de0-865f-29e3a5db9bc0 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:56.334276 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ac3d3757-3eaf-4de0-865f-29e3a5db9bc0 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:56.558653 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ac3d3757-3eaf-4de0-865f-29e3a5db9bc0 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:56.566347 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ac3d3757-3eaf-4de0-865f-29e3a5db9bc0 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.244702 Jan 28 01:04:56.566943 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 405/845] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:04:56 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:04:57.585542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b770bb5e-39f9-4a7a-9eee-15e15e9d52da tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:57.586167 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b770bb5e-39f9-4a7a-9eee-15e15e9d52da tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:57.592348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b770bb5e-39f9-4a7a-9eee-15e15e9d52da tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:57.592799 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b770bb5e-39f9-4a7a-9eee-15e15e9d52da tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:57.593612 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b770bb5e-39f9-4a7a-9eee-15e15e9d52da tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:57.594055 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b770bb5e-39f9-4a7a-9eee-15e15e9d52da tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:57.727101 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b770bb5e-39f9-4a7a-9eee-15e15e9d52da tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:57.739448 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b770bb5e-39f9-4a7a-9eee-15e15e9d52da tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.158335 Jan 28 01:04:57.740207 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 441/846] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:04:57 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:04:58.756451 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d4de87e3-0810-4bc7-8123-f3f668c8936d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:58.757066 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d4de87e3-0810-4bc7-8123-f3f668c8936d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:58.763425 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d4de87e3-0810-4bc7-8123-f3f668c8936d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:58.763880 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d4de87e3-0810-4bc7-8123-f3f668c8936d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:58.764663 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d4de87e3-0810-4bc7-8123-f3f668c8936d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:58.765103 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d4de87e3-0810-4bc7-8123-f3f668c8936d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:58.901203 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d4de87e3-0810-4bc7-8123-f3f668c8936d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:04:58.908854 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d4de87e3-0810-4bc7-8123-f3f668c8936d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.156040 Jan 28 01:04:58.909418 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 406/847] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:04:58 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:04:59.925923 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4c333f14-5ca4-4d70-8549-23e81f1432f2 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:04:59.926609 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4c333f14-5ca4-4d70-8549-23e81f1432f2 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:04:59.933913 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c333f14-5ca4-4d70-8549-23e81f1432f2 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:59.934401 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c333f14-5ca4-4d70-8549-23e81f1432f2 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:04:59.935346 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c333f14-5ca4-4d70-8549-23e81f1432f2 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:04:59.935766 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c333f14-5ca4-4d70-8549-23e81f1432f2 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:00.068453 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4c333f14-5ca4-4d70-8549-23e81f1432f2 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:00.075749 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4c333f14-5ca4-4d70-8549-23e81f1432f2 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.153533 Jan 28 01:05:00.076317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 442/848] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:04:59 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:01.092489 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6792de51-da6a-4a1b-a7c5-f51a5071f9f5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:01.093100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6792de51-da6a-4a1b-a7c5-f51a5071f9f5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:01.099416 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6792de51-da6a-4a1b-a7c5-f51a5071f9f5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:01.099870 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6792de51-da6a-4a1b-a7c5-f51a5071f9f5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:01.101150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6792de51-da6a-4a1b-a7c5-f51a5071f9f5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:01.101593 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6792de51-da6a-4a1b-a7c5-f51a5071f9f5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:01.236865 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-6792de51-da6a-4a1b-a7c5-f51a5071f9f5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:01.244178 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6792de51-da6a-4a1b-a7c5-f51a5071f9f5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.155327 Jan 28 01:05:01.244751 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 407/849] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:01 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:01.544309 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-732208709", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:01.592578 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] validate_networks() for None {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:05:01.867663 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:05:01.868092 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:05:01.868572 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:05:01.868987 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:05:01.869405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:05:01.877969 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:01.878424 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:01.879280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:01.879722 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:01.896224 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Getting quotas for project 3715d07030a94d07b157069945ecab20. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:05:01.900637 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Getting quotas for user 3af6e17d1570441c9e1089ad503fde2e and project 3715d07030a94d07b157069945ecab20. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:05:01.911496 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:05:01.913782 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:05:01.957146 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-73f49814-42dd-4489-a8e1-1ffccc47ceac tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.416412 Jan 28 01:05:01.957800 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 443/850] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:05:01.967466 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8958aec9-6d83-4b3b-a556-f0495547c2ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:01.968088 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8958aec9-6d83-4b3b-a556-f0495547c2ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:02.017937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8958aec9-6d83-4b3b-a556-f0495547c2ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:02.024739 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8958aec9-6d83-4b3b-a556-f0495547c2ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1214 microversion: 2.1 time: 0.060859 Jan 28 01:05:02.025313 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 408/851] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:01 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1214 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:02.261183 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2d615e25-8179-4ba0-a7be-666c8fa20edf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:02.261820 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2d615e25-8179-4ba0-a7be-666c8fa20edf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:02.267814 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d615e25-8179-4ba0-a7be-666c8fa20edf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:02.268336 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d615e25-8179-4ba0-a7be-666c8fa20edf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:02.269139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d615e25-8179-4ba0-a7be-666c8fa20edf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:02.269579 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d615e25-8179-4ba0-a7be-666c8fa20edf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:02.406172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2d615e25-8179-4ba0-a7be-666c8fa20edf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:02.413760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2d615e25-8179-4ba0-a7be-666c8fa20edf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.156419 Jan 28 01:05:02.414345 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 444/852] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:02 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:03.043386 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5c8d3650-da0a-41af-b40a-4a0ea62ab8f0 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:03.044446 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5c8d3650-da0a-41af-b40a-4a0ea62ab8f0 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:03.051836 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5c8d3650-da0a-41af-b40a-4a0ea62ab8f0 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:03.052308 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5c8d3650-da0a-41af-b40a-4a0ea62ab8f0 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:03.053281 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5c8d3650-da0a-41af-b40a-4a0ea62ab8f0 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:03.054297 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5c8d3650-da0a-41af-b40a-4a0ea62ab8f0 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:03.157411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5c8d3650-da0a-41af-b40a-4a0ea62ab8f0 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:03.165173 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5c8d3650-da0a-41af-b40a-4a0ea62ab8f0 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1284 microversion: 2.1 time: 0.127378 Jan 28 01:05:03.165737 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 409/853] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:03 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:03.431070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-57ab36d1-7b97-4d7a-ab99-89e4e5ed4f9e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:03.432714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-57ab36d1-7b97-4d7a-ab99-89e4e5ed4f9e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:03.439558 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-57ab36d1-7b97-4d7a-ab99-89e4e5ed4f9e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:03.440011 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-57ab36d1-7b97-4d7a-ab99-89e4e5ed4f9e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:03.440796 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-57ab36d1-7b97-4d7a-ab99-89e4e5ed4f9e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:03.441234 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-57ab36d1-7b97-4d7a-ab99-89e4e5ed4f9e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:03.575126 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-57ab36d1-7b97-4d7a-ab99-89e4e5ed4f9e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:03.582601 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-57ab36d1-7b97-4d7a-ab99-89e4e5ed4f9e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.155474 Jan 28 01:05:03.583199 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 445/854] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:03 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:04.182059 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0ab0a12a-36f2-4113-a520-c64ce4e62f01 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:04.182598 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0ab0a12a-36f2-4113-a520-c64ce4e62f01 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:04.189107 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ab0a12a-36f2-4113-a520-c64ce4e62f01 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:04.189553 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ab0a12a-36f2-4113-a520-c64ce4e62f01 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:04.190352 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ab0a12a-36f2-4113-a520-c64ce4e62f01 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:04.190827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0ab0a12a-36f2-4113-a520-c64ce4e62f01 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:04.423681 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0ab0a12a-36f2-4113-a520-c64ce4e62f01 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:04.431662 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0ab0a12a-36f2-4113-a520-c64ce4e62f01 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1314 microversion: 2.1 time: 0.253875 Jan 28 01:05:04.432247 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 410/855] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:04 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:04.574543 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-66d53438-6b02-44c4-8025-46d4633ffae6 req-a605df3d-2560-45e0-8bfb-03a3fe1fcead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14271498-1e2a-4951-8ba9-1e5cdc54a0f0", "tag": "6687461d-6d42-4d48-aa2c-f04f19438eb1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:04.576436 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:04.576436 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:05:04.598597 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-542167b9-774b-4f85-aab1-92f9b8ece47a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:04.599352 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-542167b9-774b-4f85-aab1-92f9b8ece47a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:04.606168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-542167b9-774b-4f85-aab1-92f9b8ece47a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:04.606624 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-542167b9-774b-4f85-aab1-92f9b8ece47a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:04.607467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-542167b9-774b-4f85-aab1-92f9b8ece47a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:04.607919 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-542167b9-774b-4f85-aab1-92f9b8ece47a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:04.611102 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-66d53438-6b02-44c4-8025-46d4633ffae6 req-a605df3d-2560-45e0-8bfb-03a3fe1fcead service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:04.611564 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-66d53438-6b02-44c4-8025-46d4633ffae6 req-a605df3d-2560-45e0-8bfb-03a3fe1fcead service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:04.623875 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-66d53438-6b02-44c4-8025-46d4633ffae6 req-a605df3d-2560-45e0-8bfb-03a3fe1fcead service nova] Creating event network-changed:6687461d-6d42-4d48-aa2c-f04f19438eb1 for instance 14271498-1e2a-4951-8ba9-1e5cdc54a0f0 on hv-cinder-81689 Jan 28 01:05:04.634434 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-66d53438-6b02-44c4-8025-46d4633ffae6 req-a605df3d-2560-45e0-8bfb-03a3fe1fcead service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063422 Jan 28 01:05:04.635276 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 446/856] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:05:04.830666 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-542167b9-774b-4f85-aab1-92f9b8ece47a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:04.843058 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-542167b9-774b-4f85-aab1-92f9b8ece47a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.247982 Jan 28 01:05:04.843636 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 411/857] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:04 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:05.449760 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-58188de8-0d05-4881-abc4-87afa6efb356 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:05.450639 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-58188de8-0d05-4881-abc4-87afa6efb356 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:05.456901 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-58188de8-0d05-4881-abc4-87afa6efb356 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:05.457358 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-58188de8-0d05-4881-abc4-87afa6efb356 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:05.458145 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-58188de8-0d05-4881-abc4-87afa6efb356 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:05.458580 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-58188de8-0d05-4881-abc4-87afa6efb356 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:05.598712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-58188de8-0d05-4881-abc4-87afa6efb356 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:05.606185 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-58188de8-0d05-4881-abc4-87afa6efb356 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1314 microversion: 2.1 time: 0.160396 Jan 28 01:05:05.606761 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 447/858] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:05 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:05.863603 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8b1b43e6-f60e-428b-ba61-c25dc67319f8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:05.864317 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8b1b43e6-f60e-428b-ba61-c25dc67319f8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:05.875183 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8b1b43e6-f60e-428b-ba61-c25dc67319f8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:05.875646 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8b1b43e6-f60e-428b-ba61-c25dc67319f8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:05.876448 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8b1b43e6-f60e-428b-ba61-c25dc67319f8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:05.876897 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8b1b43e6-f60e-428b-ba61-c25dc67319f8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:06.003370 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8b1b43e6-f60e-428b-ba61-c25dc67319f8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:06.011460 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8b1b43e6-f60e-428b-ba61-c25dc67319f8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.155290 Jan 28 01:05:06.012035 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 412/859] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:05 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:06.623230 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7c474017-616a-4f90-a547-d480b3c6f0ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:06.623848 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7c474017-616a-4f90-a547-d480b3c6f0ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:06.630695 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7c474017-616a-4f90-a547-d480b3c6f0ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:06.631207 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7c474017-616a-4f90-a547-d480b3c6f0ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:06.632059 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7c474017-616a-4f90-a547-d480b3c6f0ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:06.632477 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7c474017-616a-4f90-a547-d480b3c6f0ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:06.762217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7c474017-616a-4f90-a547-d480b3c6f0ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:06.769745 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7c474017-616a-4f90-a547-d480b3c6f0ad tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1314 microversion: 2.1 time: 0.150185 Jan 28 01:05:06.770311 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 448/860] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:06 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:07.028926 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f1e6ddc6-7f6a-4090-8e28-3dd7b0658424 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:07.029538 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f1e6ddc6-7f6a-4090-8e28-3dd7b0658424 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:07.035993 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddc6-7f6a-4090-8e28-3dd7b0658424 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:07.036444 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddc6-7f6a-4090-8e28-3dd7b0658424 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:07.037232 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddc6-7f6a-4090-8e28-3dd7b0658424 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:07.037671 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddc6-7f6a-4090-8e28-3dd7b0658424 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:07.171448 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f1e6ddc6-7f6a-4090-8e28-3dd7b0658424 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:07.178849 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f1e6ddc6-7f6a-4090-8e28-3dd7b0658424 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.154105 Jan 28 01:05:07.179547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 413/861] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:07 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:07.787284 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1ff14121-44f9-4b9a-984f-59558f87d4d6 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:07.787911 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1ff14121-44f9-4b9a-984f-59558f87d4d6 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:07.794220 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1ff14121-44f9-4b9a-984f-59558f87d4d6 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:07.794679 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1ff14121-44f9-4b9a-984f-59558f87d4d6 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:07.795612 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1ff14121-44f9-4b9a-984f-59558f87d4d6 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:07.796065 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1ff14121-44f9-4b9a-984f-59558f87d4d6 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:07.927407 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1ff14121-44f9-4b9a-984f-59558f87d4d6 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:07.935217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1ff14121-44f9-4b9a-984f-59558f87d4d6 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1314 microversion: 2.1 time: 0.151539 Jan 28 01:05:07.935753 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 449/862] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:07 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:05:08.196109 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cb5bcf92-15f7-4365-bf8c-778125a53f8b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:08.196689 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cb5bcf92-15f7-4365-bf8c-778125a53f8b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:08.203028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf92-15f7-4365-bf8c-778125a53f8b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.203490 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf92-15f7-4365-bf8c-778125a53f8b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:08.204284 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf92-15f7-4365-bf8c-778125a53f8b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.204728 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf92-15f7-4365-bf8c-778125a53f8b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:08.317749 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0776bd8f-6007-4b43-b32b-e772a05f5800 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:08.318733 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0776bd8f-6007-4b43-b32b-e772a05f5800 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:08.324542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0776bd8f-6007-4b43-b32b-e772a05f5800 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.324997 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0776bd8f-6007-4b43-b32b-e772a05f5800 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:08.325786 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0776bd8f-6007-4b43-b32b-e772a05f5800 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.326226 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0776bd8f-6007-4b43-b32b-e772a05f5800 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:08.334300 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-cb5bcf92-15f7-4365-bf8c-778125a53f8b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:08.341904 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cb5bcf92-15f7-4365-bf8c-778125a53f8b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.150066 Jan 28 01:05:08.342469 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 414/863] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:08 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:08.355234 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0776bd8f-6007-4b43-b32b-e772a05f5800 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041310 Jan 28 01:05:08.355790 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 450/864] 10.222.0.78 () {60 vars in 1342 bytes} [Fri Jan 28 01:05:08 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:05:08.411491 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-04903e05-386e-49a2-be07-1ee107a624dc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:08.412111 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-04903e05-386e-49a2-be07-1ee107a624dc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:08.418471 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-04903e05-386e-49a2-be07-1ee107a624dc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.418971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-04903e05-386e-49a2-be07-1ee107a624dc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:08.419766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-04903e05-386e-49a2-be07-1ee107a624dc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.420206 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-04903e05-386e-49a2-be07-1ee107a624dc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:08.445133 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-04903e05-386e-49a2-be07-1ee107a624dc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:05:08.520027 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-04903e05-386e-49a2-be07-1ee107a624dc tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 204 len: 0 microversion: 2.20 time: 0.111778 Jan 28 01:05:08.521000 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 415/865] 10.222.0.78 () {60 vars in 1279 bytes} [Fri Jan 28 01:05:08 2022] DELETE /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 01:05:08.529563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:08.530194 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:08.536141 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.536611 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:08.537406 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.538372 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:08.662561 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:08.670993 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:08.672514 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:08.673758 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f753f29d-08f8-4f39-82c3-41bdf501b7a2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.148138 Jan 28 01:05:08.674319 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 451/866] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:05:08 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:05:08.953044 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bfdedc5b-fef9-4201-be11-501ad125c5e5 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:08.953749 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-bfdedc5b-fef9-4201-be11-501ad125c5e5 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:08.959726 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bfdedc5b-fef9-4201-be11-501ad125c5e5 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.960181 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bfdedc5b-fef9-4201-be11-501ad125c5e5 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:08.960978 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bfdedc5b-fef9-4201-be11-501ad125c5e5 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:08.961418 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bfdedc5b-fef9-4201-be11-501ad125c5e5 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:09.095008 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-bfdedc5b-fef9-4201-be11-501ad125c5e5 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:09.102763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bfdedc5b-fef9-4201-be11-501ad125c5e5 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1314 microversion: 2.1 time: 0.153980 Jan 28 01:05:09.103583 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 416/867] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:08 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:09.181754 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-33fafc57-85f5-4000-ae46-fa5875cad60f req-7b14490a-3bb7-486a-b9c9-7eee996600cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14271498-1e2a-4951-8ba9-1e5cdc54a0f0", "name": "network-vif-plugged", "status": "completed", "tag": "6687461d-6d42-4d48-aa2c-f04f19438eb1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:09.196882 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:09.196882 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:05:09.196882 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-33fafc57-85f5-4000-ae46-fa5875cad60f req-7b14490a-3bb7-486a-b9c9-7eee996600cf service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:09.196882 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-33fafc57-85f5-4000-ae46-fa5875cad60f req-7b14490a-3bb7-486a-b9c9-7eee996600cf service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:09.207960 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-33fafc57-85f5-4000-ae46-fa5875cad60f req-7b14490a-3bb7-486a-b9c9-7eee996600cf service nova] Creating event network-vif-plugged:6687461d-6d42-4d48-aa2c-f04f19438eb1 for instance 14271498-1e2a-4951-8ba9-1e5cdc54a0f0 on hv-cinder-81689 Jan 28 01:05:09.213239 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-33fafc57-85f5-4000-ae46-fa5875cad60f req-7b14490a-3bb7-486a-b9c9-7eee996600cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035100 Jan 28 01:05:09.213911 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 452/868] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:09.359841 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3c2a7780-d8ff-4c7a-b84d-00c1cbaaf167 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:09.360495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3c2a7780-d8ff-4c7a-b84d-00c1cbaaf167 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:09.367602 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c2a7780-d8ff-4c7a-b84d-00c1cbaaf167 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:09.368127 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c2a7780-d8ff-4c7a-b84d-00c1cbaaf167 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:09.369070 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c2a7780-d8ff-4c7a-b84d-00c1cbaaf167 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:09.369511 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3c2a7780-d8ff-4c7a-b84d-00c1cbaaf167 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:09.553350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3c2a7780-d8ff-4c7a-b84d-00c1cbaaf167 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:09.561223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3c2a7780-d8ff-4c7a-b84d-00c1cbaaf167 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.205523 Jan 28 01:05:09.561678 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 417/869] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:09 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:09.692249 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:09.692971 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:09.699421 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:09.699867 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:09.700645 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:09.701079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:09.840049 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:09.848228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:09.849737 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:09.850922 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9e921404-c120-478b-9033-c6b75a95e398 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.162807 Jan 28 01:05:09.851479 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 453/870] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:05:09 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:05:10.119763 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0b65262b-7262-44de-a690-61c886c02626 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:10.120373 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0b65262b-7262-44de-a690-61c886c02626 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:10.126269 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0b65262b-7262-44de-a690-61c886c02626 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:10.126721 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0b65262b-7262-44de-a690-61c886c02626 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:10.127531 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0b65262b-7262-44de-a690-61c886c02626 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:10.127965 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0b65262b-7262-44de-a690-61c886c02626 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:10.254569 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0b65262b-7262-44de-a690-61c886c02626 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:10.262361 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0b65262b-7262-44de-a690-61c886c02626 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1314 microversion: 2.1 time: 0.146255 Jan 28 01:05:10.262935 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 418/871] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:10 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:10.576799 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ae73e0bb-da4f-41ba-a4b9-81fd80df9fd8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:10.577443 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ae73e0bb-da4f-41ba-a4b9-81fd80df9fd8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:10.584003 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ae73e0bb-da4f-41ba-a4b9-81fd80df9fd8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:10.584458 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ae73e0bb-da4f-41ba-a4b9-81fd80df9fd8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:10.585821 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ae73e0bb-da4f-41ba-a4b9-81fd80df9fd8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:10.586260 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ae73e0bb-da4f-41ba-a4b9-81fd80df9fd8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:10.717120 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ae73e0bb-da4f-41ba-a4b9-81fd80df9fd8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:10.725063 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ae73e0bb-da4f-41ba-a4b9-81fd80df9fd8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.151781 Jan 28 01:05:10.725728 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 454/872] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:10 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:10.869189 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:10.869937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:10.877246 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:10.877704 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:10.878510 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:10.879035 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.228623 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-2cd0efbc-9ce0-4e67-b2b7-039bd2137273 req-e316ad15-6862-4213-aba7-c929ed87c9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd", "name": "network-vif-plugged", "status": "completed", "tag": "0358ec0e-3460-4353-ba22-1ecfe9abe10c"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:11.230211 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:11.230211 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:05:11.237447 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-2cd0efbc-9ce0-4e67-b2b7-039bd2137273 req-e316ad15-6862-4213-aba7-c929ed87c9cd service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:11.237886 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-2cd0efbc-9ce0-4e67-b2b7-039bd2137273 req-e316ad15-6862-4213-aba7-c929ed87c9cd service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.249784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-2cd0efbc-9ce0-4e67-b2b7-039bd2137273 req-e316ad15-6862-4213-aba7-c929ed87c9cd service nova] Creating event network-vif-plugged:0358ec0e-3460-4353-ba22-1ecfe9abe10c for instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd on hv-cinder-81689 Jan 28 01:05:11.254516 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-2cd0efbc-9ce0-4e67-b2b7-039bd2137273 req-e316ad15-6862-4213-aba7-c929ed87c9cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029576 Jan 28 01:05:11.255143 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 455/873] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:05:11.279800 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1485d9f5-cea0-404b-828b-6197e31ec9d1 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:11.280588 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1485d9f5-cea0-404b-828b-6197e31ec9d1 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:11.287012 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1485d9f5-cea0-404b-828b-6197e31ec9d1 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:11.287450 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1485d9f5-cea0-404b-828b-6197e31ec9d1 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.288790 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1485d9f5-cea0-404b-828b-6197e31ec9d1 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:11.289220 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1485d9f5-cea0-404b-828b-6197e31ec9d1 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.333424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:11.341326 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:11.342835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:11.344032 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b24417c1-d7c3-45ef-bfbd-ed97fe5d0991 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1723 microversion: 2.20 time: 0.479002 Jan 28 01:05:11.344590 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 419/874] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:05:10 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:05:11.423866 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1485d9f5-cea0-404b-828b-6197e31ec9d1 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:11.433869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1485d9f5-cea0-404b-828b-6197e31ec9d1 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1464 microversion: 2.1 time: 0.158341 Jan 28 01:05:11.434704 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 456/875] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:11 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:05:11.477275 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-14cb9961-31fc-453c-b57c-8c2b49631ec7 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:11.477785 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-14cb9961-31fc-453c-b57c-8c2b49631ec7 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:11.484245 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-14cb9961-31fc-453c-b57c-8c2b49631ec7 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:11.484818 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-14cb9961-31fc-453c-b57c-8c2b49631ec7 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.485778 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-14cb9961-31fc-453c-b57c-8c2b49631ec7 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:11.486528 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-14cb9961-31fc-453c-b57c-8c2b49631ec7 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.513539 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-14cb9961-31fc-453c-b57c-8c2b49631ec7 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:05:11.607311 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-14cb9961-31fc-453c-b57c-8c2b49631ec7 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "DELETE /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 204 len: 0 microversion: 2.1 time: 0.133798 Jan 28 01:05:11.608219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 420/876] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:05:11 2022] DELETE /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:05:11.617718 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fa365380-4cec-432a-9742-dc45461e706d tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:11.618336 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fa365380-4cec-432a-9742-dc45461e706d tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:11.624914 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fa365380-4cec-432a-9742-dc45461e706d tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:11.625369 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fa365380-4cec-432a-9742-dc45461e706d tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.626189 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fa365380-4cec-432a-9742-dc45461e706d tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:11.626631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fa365380-4cec-432a-9742-dc45461e706d tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.742482 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-153f1e5a-0116-4479-85ff-3341b3da774b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:11.743270 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-153f1e5a-0116-4479-85ff-3341b3da774b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:11.752276 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-153f1e5a-0116-4479-85ff-3341b3da774b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:11.752741 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-153f1e5a-0116-4479-85ff-3341b3da774b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.753562 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-153f1e5a-0116-4479-85ff-3341b3da774b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:11.754012 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-153f1e5a-0116-4479-85ff-3341b3da774b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:11.770551 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-fa365380-4cec-432a-9742-dc45461e706d tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:11.780376 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fa365380-4cec-432a-9742-dc45461e706d tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1470 microversion: 2.1 time: 0.167304 Jan 28 01:05:11.781180 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 457/877] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:11 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:12.007882 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-153f1e5a-0116-4479-85ff-3341b3da774b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:12.015238 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-153f1e5a-0116-4479-85ff-3341b3da774b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1267 microversion: 2.1 time: 0.277162 Jan 28 01:05:12.016050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 421/878] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:11 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1267 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:12.082482 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-f6e2a91f-0aa0-4f66-baed-f69676ef2a80 req-b54717db-955c-4907-83d4-ee2418f40770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff9f97-2065-4e4e-8e55-28563a35288c", "name": "network-vif-deleted", "tag": "70dfd08a-1b60-4f24-ac93-be76036044f2"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:12.084232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:12.084232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:05:12.092694 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-f6e2a91f-0aa0-4f66-baed-f69676ef2a80 req-b54717db-955c-4907-83d4-ee2418f40770 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:12.093407 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-f6e2a91f-0aa0-4f66-baed-f69676ef2a80 req-b54717db-955c-4907-83d4-ee2418f40770 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:12.106532 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-f6e2a91f-0aa0-4f66-baed-f69676ef2a80 req-b54717db-955c-4907-83d4-ee2418f40770 service nova] Creating event network-vif-deleted:70dfd08a-1b60-4f24-ac93-be76036044f2 for instance 2bff9f97-2065-4e4e-8e55-28563a35288c on hv-cinder-81689 Jan 28 01:05:12.111858 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-f6e2a91f-0aa0-4f66-baed-f69676ef2a80 req-b54717db-955c-4907-83d4-ee2418f40770 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 Jan 28 01:05:12.112690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 458/879] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:12.363124 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:12.363635 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:12.370195 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:12.370652 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:12.371466 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:12.371907 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:12.403408 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:12.403859 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:12.404324 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lazy-loading 'fault' on Instance uuid 2bff9f97-2065-4e4e-8e55-28563a35288c {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:05:12.447759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:12.456444 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:12.458558 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f4f91c9bc9d45cd8bea88e4c59c70ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1619efcedc544fabe3b60eef955ce40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:12.460523 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f3b73013-0fb5-4688-a1db-ab59b493eeb1 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 200 len: 1371 microversion: 2.20 time: 0.101270 Jan 28 01:05:12.461095 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 422/880] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:05:12 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:05:12.799624 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1d61f169-e42a-4d2b-a9b1-a1edc458f942 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:12.807288 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1d61f169-e42a-4d2b-a9b1-a1edc458f942 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:12.823051 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1d61f169-e42a-4d2b-a9b1-a1edc458f942 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:12.823509 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1d61f169-e42a-4d2b-a9b1-a1edc458f942 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:12.824314 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1d61f169-e42a-4d2b-a9b1-a1edc458f942 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:12.824754 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1d61f169-e42a-4d2b-a9b1-a1edc458f942 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:12.969617 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1d61f169-e42a-4d2b-a9b1-a1edc458f942 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:12.981174 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1d61f169-e42a-4d2b-a9b1-a1edc458f942 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1470 microversion: 2.1 time: 0.184061 Jan 28 01:05:12.984488 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 459/881] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:12 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:13.032618 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4f0bfab7-c221-445f-b52e-4145e94a87d4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:13.033851 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4f0bfab7-c221-445f-b52e-4145e94a87d4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:13.040340 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f0bfab7-c221-445f-b52e-4145e94a87d4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:13.040789 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f0bfab7-c221-445f-b52e-4145e94a87d4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:13.041570 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f0bfab7-c221-445f-b52e-4145e94a87d4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:13.042182 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f0bfab7-c221-445f-b52e-4145e94a87d4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:13.174718 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4f0bfab7-c221-445f-b52e-4145e94a87d4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:13.182903 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4f0bfab7-c221-445f-b52e-4145e94a87d4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1455 microversion: 2.1 time: 0.153854 Jan 28 01:05:13.183643 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 423/882] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:13 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:13.199771 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3fbe23de-443c-47f6-a367-fb762b510590 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:13.200450 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3fbe23de-443c-47f6-a367-fb762b510590 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:13.206663 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3fbe23de-443c-47f6-a367-fb762b510590 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:13.207476 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3fbe23de-443c-47f6-a367-fb762b510590 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:13.207956 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3fbe23de-443c-47f6-a367-fb762b510590 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:13.208403 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3fbe23de-443c-47f6-a367-fb762b510590 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:13.345596 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3fbe23de-443c-47f6-a367-fb762b510590 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:13.352973 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3fbe23de-443c-47f6-a367-fb762b510590 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1455 microversion: 2.1 time: 0.156831 Jan 28 01:05:13.353544 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 460/883] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:13 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:13.478666 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9062f42f-d64d-4e1e-83aa-c32edb8234f6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:13.479332 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9062f42f-d64d-4e1e-83aa-c32edb8234f6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:13.485034 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9062f42f-d64d-4e1e-83aa-c32edb8234f6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:13.485495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9062f42f-d64d-4e1e-83aa-c32edb8234f6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:13.486286 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9062f42f-d64d-4e1e-83aa-c32edb8234f6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:13.486723 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9062f42f-d64d-4e1e-83aa-c32edb8234f6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:13.500483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-9062f42f-d64d-4e1e-83aa-c32edb8234f6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] HTTP exception thrown: Instance 2bff9f97-2065-4e4e-8e55-28563a35288c could not be found. Jan 28 01:05:13.501085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9062f42f-d64d-4e1e-83aa-c32edb8234f6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Returning 404 to user: Instance 2bff9f97-2065-4e4e-8e55-28563a35288c could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:05:13.501920 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9062f42f-d64d-4e1e-83aa-c32edb8234f6 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 404 len: 111 microversion: 2.20 time: 0.027012 Jan 28 01:05:13.502463 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 424/884] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:05:13 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:05:13.511462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-184e1af4-69db-42da-9ae3-7139b1505457 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '.version_select at 0x7f1a091b7ee0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:13.529160 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-184e1af4-69db-42da-9ae3-7139b1505457 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393450532" status: 204 len: 0 microversion: 2.20 time: 0.021308 Jan 28 01:05:13.530029 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 461/885] 10.222.0.78 () {60 vars in 1261 bytes} [Fri Jan 28 01:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393450532 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 01:05:14.001761 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-307d3235-f23b-488f-b3ed-a0f4667da280 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:14.002452 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-307d3235-f23b-488f-b3ed-a0f4667da280 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:14.008965 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-307d3235-f23b-488f-b3ed-a0f4667da280 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:14.009425 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-307d3235-f23b-488f-b3ed-a0f4667da280 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:14.010363 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-307d3235-f23b-488f-b3ed-a0f4667da280 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:14.010812 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-307d3235-f23b-488f-b3ed-a0f4667da280 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:14.354197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-307d3235-f23b-488f-b3ed-a0f4667da280 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6e17d1570441c9e1089ad503fde2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3715d07030a94d07b157069945ecab20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:14.372409 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-307d3235-f23b-488f-b3ed-a0f4667da280 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 200 len: 1470 microversion: 2.1 time: 0.372848 Jan 28 01:05:14.381311 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 425/886] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:13 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 1470 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:14.749895 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-58139904-b5a7-43a2-93a7-7cedca4ff4cc req-ca147cc5-cbbb-417b-8c18-d3fbcf0a518c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14271498-1e2a-4951-8ba9-1e5cdc54a0f0", "name": "network-vif-deleted", "tag": "6687461d-6d42-4d48-aa2c-f04f19438eb1"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:14.752079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:14.752079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:05:14.769172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-58139904-b5a7-43a2-93a7-7cedca4ff4cc req-ca147cc5-cbbb-417b-8c18-d3fbcf0a518c service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:14.770251 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-58139904-b5a7-43a2-93a7-7cedca4ff4cc req-ca147cc5-cbbb-417b-8c18-d3fbcf0a518c service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:14.785238 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-58139904-b5a7-43a2-93a7-7cedca4ff4cc req-ca147cc5-cbbb-417b-8c18-d3fbcf0a518c service nova] Creating event network-vif-deleted:6687461d-6d42-4d48-aa2c-f04f19438eb1 for instance 14271498-1e2a-4951-8ba9-1e5cdc54a0f0 on hv-cinder-81689 Jan 28 01:05:14.790364 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-58139904-b5a7-43a2-93a7-7cedca4ff4cc req-ca147cc5-cbbb-417b-8c18-d3fbcf0a518c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044978 Jan 28 01:05:14.791138 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 462/887] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:15.389761 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f1b315a1-31b7-4455-ab14-488f3f4ae027 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:15.390700 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f1b315a1-31b7-4455-ab14-488f3f4ae027 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] [instance: 14271498-1e2a-4951-8ba9-1e5cdc54a0f0] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:15.398171 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f1b315a1-31b7-4455-ab14-488f3f4ae027 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:15.399192 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f1b315a1-31b7-4455-ab14-488f3f4ae027 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:15.400112 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f1b315a1-31b7-4455-ab14-488f3f4ae027 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:15.400690 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f1b315a1-31b7-4455-ab14-488f3f4ae027 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:15.421296 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-f1b315a1-31b7-4455-ab14-488f3f4ae027 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] HTTP exception thrown: Instance 14271498-1e2a-4951-8ba9-1e5cdc54a0f0 could not be found. Jan 28 01:05:15.422309 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f1b315a1-31b7-4455-ab14-488f3f4ae027 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] Returning 404 to user: Instance 14271498-1e2a-4951-8ba9-1e5cdc54a0f0 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:05:15.423424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f1b315a1-31b7-4455-ab14-488f3f4ae027 tempest-VolumesNegativeTest-599301646 tempest-VolumesNegativeTest-599301646-project] 10.222.0.78 "GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0" status: 404 len: 111 microversion: 2.1 time: 0.037635 Jan 28 01:05:15.424213 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 426/888] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:15 2022] GET /compute/v2.1/servers/14271498-1e2a-4951-8ba9-1e5cdc54a0f0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:05:15.520543 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-0d6eb3ce-9283-4bd9-a547-6114933e9d07 req-7e770331-5b26-4352-a099-d549c15f7a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd", "tag": "0358ec0e-3460-4353-ba22-1ecfe9abe10c"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:15.522742 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:15.522742 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:05:15.530174 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-0d6eb3ce-9283-4bd9-a547-6114933e9d07 req-7e770331-5b26-4352-a099-d549c15f7a74 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:15.530628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-0d6eb3ce-9283-4bd9-a547-6114933e9d07 req-7e770331-5b26-4352-a099-d549c15f7a74 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:15.545123 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7b42ec3b-2538-4507-a939-e84ff3c89af0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:15.545693 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7b42ec3b-2538-4507-a939-e84ff3c89af0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:15.550239 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-0d6eb3ce-9283-4bd9-a547-6114933e9d07 req-7e770331-5b26-4352-a099-d549c15f7a74 service nova] Creating event network-changed:0358ec0e-3460-4353-ba22-1ecfe9abe10c for instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd on hv-cinder-81689 Jan 28 01:05:15.552616 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7b42ec3b-2538-4507-a939-e84ff3c89af0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:15.552616 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7b42ec3b-2538-4507-a939-e84ff3c89af0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:15.553335 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7b42ec3b-2538-4507-a939-e84ff3c89af0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:15.553770 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7b42ec3b-2538-4507-a939-e84ff3c89af0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:15.556795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-0d6eb3ce-9283-4bd9-a547-6114933e9d07 req-7e770331-5b26-4352-a099-d549c15f7a74 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044076 Jan 28 01:05:15.557718 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 463/889] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:15.569812 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-7b42ec3b-2538-4507-a939-e84ff3c89af0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] HTTP exception thrown: Instance 2bff9f97-2065-4e4e-8e55-28563a35288c could not be found. Jan 28 01:05:15.570583 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7b42ec3b-2538-4507-a939-e84ff3c89af0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Returning 404 to user: Instance 2bff9f97-2065-4e4e-8e55-28563a35288c could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:05:15.571441 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7b42ec3b-2538-4507-a939-e84ff3c89af0 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 404 len: 111 microversion: 2.20 time: 0.030120 Jan 28 01:05:15.571990 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 427/890] 10.222.0.78 () {60 vars in 1279 bytes} [Fri Jan 28 01:05:15 2022] DELETE /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 01:05:15.580490 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-352db6b8-8c61-4204-96d0-5cf5ae2491d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:15.581097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-352db6b8-8c61-4204-96d0-5cf5ae2491d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: 2bff9f97-2065-4e4e-8e55-28563a35288c] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:15.587764 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-352db6b8-8c61-4204-96d0-5cf5ae2491d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:15.588446 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-352db6b8-8c61-4204-96d0-5cf5ae2491d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:15.589446 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-352db6b8-8c61-4204-96d0-5cf5ae2491d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:15.589896 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-352db6b8-8c61-4204-96d0-5cf5ae2491d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:15.604131 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-352db6b8-8c61-4204-96d0-5cf5ae2491d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] HTTP exception thrown: Instance 2bff9f97-2065-4e4e-8e55-28563a35288c could not be found. Jan 28 01:05:15.605094 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-352db6b8-8c61-4204-96d0-5cf5ae2491d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Returning 404 to user: Instance 2bff9f97-2065-4e4e-8e55-28563a35288c could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:05:15.606106 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-352db6b8-8c61-4204-96d0-5cf5ae2491d2 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c" status: 404 len: 111 microversion: 2.20 time: 0.029734 Jan 28 01:05:15.606678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 464/891] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:05:15 2022] GET /compute/v2.1/servers/2bff9f97-2065-4e4e-8e55-28563a35288c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:05:16.767962 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d0d1be54-cef2-4723-b671-ffd8438b5f11 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:16.768810 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d0d1be54-cef2-4723-b671-ffd8438b5f11 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:16.778419 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d0d1be54-cef2-4723-b671-ffd8438b5f11 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:16.778910 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d0d1be54-cef2-4723-b671-ffd8438b5f11 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:16.779822 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d0d1be54-cef2-4723-b671-ffd8438b5f11 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:16.780277 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d0d1be54-cef2-4723-b671-ffd8438b5f11 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:16.794379 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-d0d1be54-cef2-4723-b671-ffd8438b5f11 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] HTTP exception thrown: Instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 could not be found. Jan 28 01:05:16.795064 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d0d1be54-cef2-4723-b671-ffd8438b5f11 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Returning 404 to user: Instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:05:16.795914 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d0d1be54-cef2-4723-b671-ffd8438b5f11 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 404 len: 111 microversion: 2.20 time: 0.034607 Jan 28 01:05:16.796464 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 428/892] 10.222.0.78 () {60 vars in 1279 bytes} [Fri Jan 28 01:05:16 2022] DELETE /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:05:16.805941 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-63a569aa-378f-4e59-811f-39c41700df61 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:16.806647 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-63a569aa-378f-4e59-811f-39c41700df61 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] [instance: b8ab5025-62f7-40d2-b976-95ed4c6f0499] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:16.813692 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-63a569aa-378f-4e59-811f-39c41700df61 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:16.814184 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-63a569aa-378f-4e59-811f-39c41700df61 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:16.815022 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-63a569aa-378f-4e59-811f-39c41700df61 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:16.815475 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-63a569aa-378f-4e59-811f-39c41700df61 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:16.829995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-63a569aa-378f-4e59-811f-39c41700df61 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] HTTP exception thrown: Instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 could not be found. Jan 28 01:05:16.830627 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-63a569aa-378f-4e59-811f-39c41700df61 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] Returning 404 to user: Instance b8ab5025-62f7-40d2-b976-95ed4c6f0499 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:05:16.831581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-63a569aa-378f-4e59-811f-39c41700df61 tempest-AttachVolumeShelveTestJSON-749826720 tempest-AttachVolumeShelveTestJSON-749826720-project] 10.222.0.78 "GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499" status: 404 len: 111 microversion: 2.20 time: 0.030715 Jan 28 01:05:16.832138 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 465/893] 10.222.0.78 () {60 vars in 1276 bytes} [Fri Jan 28 01:05:16 2022] GET /compute/v2.1/servers/b8ab5025-62f7-40d2-b976-95ed4c6f0499 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 01:05:19.064764 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5c45fb03-4ce4-4652-9c15-e42de9ec15c9 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:19.069881 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5c45fb03-4ce4-4652-9c15-e42de9ec15c9 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:19.077555 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5c45fb03-4ce4-4652-9c15-e42de9ec15c9 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:19.078014 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5c45fb03-4ce4-4652-9c15-e42de9ec15c9 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:19.078848 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5c45fb03-4ce4-4652-9c15-e42de9ec15c9 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:19.079617 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5c45fb03-4ce4-4652-9c15-e42de9ec15c9 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:19.104216 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-5c45fb03-4ce4-4652-9c15-e42de9ec15c9 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lazy-loading 'flavor' on Instance uuid 47e78861-36ac-4839-a201-ad85a067439a {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:05:19.229276 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5c45fb03-4ce4-4652-9c15-e42de9ec15c9 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "POST /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a/action" status: 202 len: 0 microversion: 2.1 time: 0.168060 Jan 28 01:05:19.229875 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 429/894] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:19 2022] POST /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:05:19.238164 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1de9aff4-084b-4842-aa7c-7e5e23ef1874 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:19.239380 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1de9aff4-084b-4842-aa7c-7e5e23ef1874 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:19.246156 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1de9aff4-084b-4842-aa7c-7e5e23ef1874 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:19.246651 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1de9aff4-084b-4842-aa7c-7e5e23ef1874 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:19.247545 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1de9aff4-084b-4842-aa7c-7e5e23ef1874 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:19.248299 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1de9aff4-084b-4842-aa7c-7e5e23ef1874 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:19.395151 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1de9aff4-084b-4842-aa7c-7e5e23ef1874 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:19.405082 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1de9aff4-084b-4842-aa7c-7e5e23ef1874 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.170720 Jan 28 01:05:19.405921 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 466/895] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:19 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:20.427835 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a7783ffc-9d4f-41f4-9474-f47c1a77aa20 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:20.429187 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a7783ffc-9d4f-41f4-9474-f47c1a77aa20 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:20.435217 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a7783ffc-9d4f-41f4-9474-f47c1a77aa20 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:20.435732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a7783ffc-9d4f-41f4-9474-f47c1a77aa20 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:20.436615 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a7783ffc-9d4f-41f4-9474-f47c1a77aa20 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:20.437164 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a7783ffc-9d4f-41f4-9474-f47c1a77aa20 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:20.583274 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a7783ffc-9d4f-41f4-9474-f47c1a77aa20 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:20.591123 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a7783ffc-9d4f-41f4-9474-f47c1a77aa20 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.167778 Jan 28 01:05:20.591696 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 430/896] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:20 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:21.608785 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f076bd67-0482-4bef-9f5e-c96e8b0decd0 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:21.609404 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f076bd67-0482-4bef-9f5e-c96e8b0decd0 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:21.616269 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f076bd67-0482-4bef-9f5e-c96e8b0decd0 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:21.616724 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f076bd67-0482-4bef-9f5e-c96e8b0decd0 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:21.617575 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f076bd67-0482-4bef-9f5e-c96e8b0decd0 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:21.618230 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f076bd67-0482-4bef-9f5e-c96e8b0decd0 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:21.774073 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-f076bd67-0482-4bef-9f5e-c96e8b0decd0 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:21.781794 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f076bd67-0482-4bef-9f5e-c96e8b0decd0 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.176638 Jan 28 01:05:21.782418 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 467/897] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:21 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:22.801664 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4b284423-a087-46b6-8405-b0845e4f8f6a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:22.802845 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4b284423-a087-46b6-8405-b0845e4f8f6a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:22.809709 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4b284423-a087-46b6-8405-b0845e4f8f6a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:22.810410 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4b284423-a087-46b6-8405-b0845e4f8f6a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:22.811567 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4b284423-a087-46b6-8405-b0845e4f8f6a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:22.812159 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4b284423-a087-46b6-8405-b0845e4f8f6a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:23.030873 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4b284423-a087-46b6-8405-b0845e4f8f6a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:23.039362 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4b284423-a087-46b6-8405-b0845e4f8f6a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.243752 Jan 28 01:05:23.039871 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 431/898] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:22 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:24.056385 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-929d8ffc-4de9-4840-a751-d185e9d6310c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:24.057601 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-929d8ffc-4de9-4840-a751-d185e9d6310c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:24.064433 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-929d8ffc-4de9-4840-a751-d185e9d6310c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:24.064891 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-929d8ffc-4de9-4840-a751-d185e9d6310c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:24.067883 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-929d8ffc-4de9-4840-a751-d185e9d6310c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:24.072242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-929d8ffc-4de9-4840-a751-d185e9d6310c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:24.299980 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-929d8ffc-4de9-4840-a751-d185e9d6310c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:24.309815 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-929d8ffc-4de9-4840-a751-d185e9d6310c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.257281 Jan 28 01:05:24.320007 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 468/899] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:24 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:25.340706 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-92b4a046-2d40-405e-8650-de2f885e0953 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:25.343381 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-92b4a046-2d40-405e-8650-de2f885e0953 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:25.354454 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-92b4a046-2d40-405e-8650-de2f885e0953 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:25.355125 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-92b4a046-2d40-405e-8650-de2f885e0953 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:25.357024 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-92b4a046-2d40-405e-8650-de2f885e0953 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:25.357950 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-92b4a046-2d40-405e-8650-de2f885e0953 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:25.598472 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-92b4a046-2d40-405e-8650-de2f885e0953 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:25.606839 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-92b4a046-2d40-405e-8650-de2f885e0953 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.276500 Jan 28 01:05:25.616705 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 432/900] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:25 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:26.002220 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5dbca77a-5922-41b6-930e-4ad481757f75 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'create', calling method: .version_select at 0x7f1a091f4ca0>, body: {"keypair": {"name": "tempest-keypair-1228076951"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:26.016559 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-5dbca77a-5922-41b6-930e-4ad481757f75 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for project 4ad98bf7b3c546848923e916df460759. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:05:26.020367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-5dbca77a-5922-41b6-930e-4ad481757f75 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for user 213001750f3f475b82276d5743358ec9 and project 4ad98bf7b3c546848923e916df460759. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:05:26.296959 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-5dbca77a-5922-41b6-930e-4ad481757f75 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for project 4ad98bf7b3c546848923e916df460759. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:05:26.300678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-5dbca77a-5922-41b6-930e-4ad481757f75 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for user 213001750f3f475b82276d5743358ec9 and project 4ad98bf7b3c546848923e916df460759. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:05:26.313601 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5dbca77a-5922-41b6-930e-4ad481757f75 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.428394 Jan 28 01:05:26.314197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 469/901] 10.222.0.78 () {60 vars in 1157 bytes} [Fri Jan 28 01:05:25 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:26.624448 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0592419e-7dfd-49c0-a494-7c2979ac57b2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:26.625213 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0592419e-7dfd-49c0-a494-7c2979ac57b2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:26.631626 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0592419e-7dfd-49c0-a494-7c2979ac57b2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:26.632255 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0592419e-7dfd-49c0-a494-7c2979ac57b2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:26.633044 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0592419e-7dfd-49c0-a494-7c2979ac57b2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:26.633484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0592419e-7dfd-49c0-a494-7c2979ac57b2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:26.812249 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0592419e-7dfd-49c0-a494-7c2979ac57b2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:26.823168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0592419e-7dfd-49c0-a494-7c2979ac57b2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.202528 Jan 28 01:05:26.824028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 433/902] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:26 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:27.597115 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-265465745", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f7c560b-cb68-4225-abc6-2cbb69c2b4f6"}], "security_groups": [{"name": "tempest-securitygroup--1856295885"}], "key_name": "tempest-keypair-1228076951", "user_data": "}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:27.708587 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] validate_networks() for [('1f7c560b-cb68-4225-abc6-2cbb69c2b4f6', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:05:27.840761 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b03c2bed-9789-483d-ab9d-e3febdcf342f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:27.841385 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b03c2bed-9789-483d-ab9d-e3febdcf342f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:27.847886 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b03c2bed-9789-483d-ab9d-e3febdcf342f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:27.848343 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b03c2bed-9789-483d-ab9d-e3febdcf342f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:27.849139 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b03c2bed-9789-483d-ab9d-e3febdcf342f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:27.849582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b03c2bed-9789-483d-ab9d-e3febdcf342f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:28.005536 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-b03c2bed-9789-483d-ab9d-e3febdcf342f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:28.014369 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b03c2bed-9789-483d-ab9d-e3febdcf342f tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.177109 Jan 28 01:05:28.015293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 434/903] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:27 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:05:28.134378 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:05:28.134797 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:05:28.135301 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:05:28.135707 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:05:28.136113 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:05:28.145557 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:28.146020 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:28.146924 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:28.147548 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:28.165507 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for project 4ad98bf7b3c546848923e916df460759. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:05:28.170367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for user 213001750f3f475b82276d5743358ec9 and project 4ad98bf7b3c546848923e916df460759. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:05:28.182261 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:05:28.185038 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:05:28.233975 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-322e8f25-60fb-4cb3-9be6-51cef4345dad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.642060 Jan 28 01:05:28.235215 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 470/904] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:05:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:05:28.246457 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-97a4209c-f143-4912-bdbe-2f6d64b168fc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:28.247509 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-97a4209c-f143-4912-bdbe-2f6d64b168fc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:28.305056 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-97a4209c-f143-4912-bdbe-2f6d64b168fc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:28.313396 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-97a4209c-f143-4912-bdbe-2f6d64b168fc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1237 microversion: 2.1 time: 0.070138 Jan 28 01:05:28.323531 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 435/905] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:28 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:29.032044 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1442c3ff-f120-4a59-a2a1-848d5be4f1c6 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:29.032795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1442c3ff-f120-4a59-a2a1-848d5be4f1c6 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:29.039466 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1442c3ff-f120-4a59-a2a1-848d5be4f1c6 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:29.040144 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1442c3ff-f120-4a59-a2a1-848d5be4f1c6 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:29.040932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1442c3ff-f120-4a59-a2a1-848d5be4f1c6 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:29.041542 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1442c3ff-f120-4a59-a2a1-848d5be4f1c6 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:29.177335 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1442c3ff-f120-4a59-a2a1-848d5be4f1c6 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:29.186606 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1442c3ff-f120-4a59-a2a1-848d5be4f1c6 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.158220 Jan 28 01:05:29.187466 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 471/906] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:29 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:29.329428 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-46052c58-5d27-4031-9430-8d82e6f2f26a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:29.330258 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-46052c58-5d27-4031-9430-8d82e6f2f26a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:29.338805 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-46052c58-5d27-4031-9430-8d82e6f2f26a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:29.339291 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-46052c58-5d27-4031-9430-8d82e6f2f26a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:29.340104 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-46052c58-5d27-4031-9430-8d82e6f2f26a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:29.340600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-46052c58-5d27-4031-9430-8d82e6f2f26a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:29.438325 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-46052c58-5d27-4031-9430-8d82e6f2f26a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:29.451913 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-46052c58-5d27-4031-9430-8d82e6f2f26a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1297 microversion: 2.1 time: 0.121433 Jan 28 01:05:29.452138 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 436/907] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:29 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1297 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:30.204384 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-47872ca3-4903-45af-908e-bfa6d17fbb73 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:30.205132 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-47872ca3-4903-45af-908e-bfa6d17fbb73 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:30.212240 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47872ca3-4903-45af-908e-bfa6d17fbb73 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:30.212891 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47872ca3-4903-45af-908e-bfa6d17fbb73 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:30.213875 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47872ca3-4903-45af-908e-bfa6d17fbb73 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:30.214610 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47872ca3-4903-45af-908e-bfa6d17fbb73 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:30.355889 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-47872ca3-4903-45af-908e-bfa6d17fbb73 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:30.363591 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-47872ca3-4903-45af-908e-bfa6d17fbb73 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.162913 Jan 28 01:05:30.364177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 472/908] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:30 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:30.468442 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0a1b3ba7-df6b-4a75-9e96-ae6af433b4cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:30.469094 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0a1b3ba7-df6b-4a75-9e96-ae6af433b4cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:30.476167 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a1b3ba7-df6b-4a75-9e96-ae6af433b4cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:30.476627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a1b3ba7-df6b-4a75-9e96-ae6af433b4cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:30.477424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a1b3ba7-df6b-4a75-9e96-ae6af433b4cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:30.477872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0a1b3ba7-df6b-4a75-9e96-ae6af433b4cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:30.711880 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0a1b3ba7-df6b-4a75-9e96-ae6af433b4cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:30.720258 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0a1b3ba7-df6b-4a75-9e96-ae6af433b4cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1363 microversion: 2.1 time: 0.255431 Jan 28 01:05:30.720868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 437/909] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:30 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:30.872779 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-28b76a91-eb53-4f3d-a116-1c229cbf3e3d req-486959aa-bfac-4f6e-bb3c-8e78cfc1134a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1", "tag": "28f0f27c-c64c-4ac9-a0d2-a2f7ab1a672c"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:30.874405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:30.874405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:05:30.884531 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-28b76a91-eb53-4f3d-a116-1c229cbf3e3d req-486959aa-bfac-4f6e-bb3c-8e78cfc1134a service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:30.885913 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-28b76a91-eb53-4f3d-a116-1c229cbf3e3d req-486959aa-bfac-4f6e-bb3c-8e78cfc1134a service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:30.899855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-28b76a91-eb53-4f3d-a116-1c229cbf3e3d req-486959aa-bfac-4f6e-bb3c-8e78cfc1134a service nova] Creating event network-changed:28f0f27c-c64c-4ac9-a0d2-a2f7ab1a672c for instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 on hv-cinder-81689 Jan 28 01:05:30.906666 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-28b76a91-eb53-4f3d-a116-1c229cbf3e3d req-486959aa-bfac-4f6e-bb3c-8e78cfc1134a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038414 Jan 28 01:05:30.907495 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 473/910] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:31.382283 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-092c38f9-19d8-4cc9-8c1a-ca2d1c6a432d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:31.382909 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-092c38f9-19d8-4cc9-8c1a-ca2d1c6a432d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:31.389024 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-092c38f9-19d8-4cc9-8c1a-ca2d1c6a432d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:31.389472 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-092c38f9-19d8-4cc9-8c1a-ca2d1c6a432d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:31.390254 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-092c38f9-19d8-4cc9-8c1a-ca2d1c6a432d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:31.390686 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-092c38f9-19d8-4cc9-8c1a-ca2d1c6a432d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:31.519317 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-092c38f9-19d8-4cc9-8c1a-ca2d1c6a432d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:31.526758 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-092c38f9-19d8-4cc9-8c1a-ca2d1c6a432d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.148744 Jan 28 01:05:31.527359 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 438/911] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:31 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:31.737518 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-408b118a-4ce2-4810-b724-cad64753e79f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:31.738215 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-408b118a-4ce2-4810-b724-cad64753e79f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:31.745243 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-408b118a-4ce2-4810-b724-cad64753e79f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:31.745686 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-408b118a-4ce2-4810-b724-cad64753e79f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:31.746461 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-408b118a-4ce2-4810-b724-cad64753e79f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:31.746915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-408b118a-4ce2-4810-b724-cad64753e79f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:31.877226 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-408b118a-4ce2-4810-b724-cad64753e79f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:31.884778 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-408b118a-4ce2-4810-b724-cad64753e79f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1363 microversion: 2.1 time: 0.151273 Jan 28 01:05:31.885430 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 474/912] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:31 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:32.543759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3508e73b-0d88-447b-b57c-1390393181a4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:32.544379 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3508e73b-0d88-447b-b57c-1390393181a4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:32.550641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3508e73b-0d88-447b-b57c-1390393181a4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:32.551122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3508e73b-0d88-447b-b57c-1390393181a4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:32.551906 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3508e73b-0d88-447b-b57c-1390393181a4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:32.552345 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3508e73b-0d88-447b-b57c-1390393181a4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:32.686543 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-3508e73b-0d88-447b-b57c-1390393181a4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:32.696383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3508e73b-0d88-447b-b57c-1390393181a4 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.156216 Jan 28 01:05:32.696975 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 439/913] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:32 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:32.901290 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-965b40b0-6d06-479d-8a70-c72fa48e7c2d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:32.901908 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-965b40b0-6d06-479d-8a70-c72fa48e7c2d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:32.908501 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-965b40b0-6d06-479d-8a70-c72fa48e7c2d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:32.908951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-965b40b0-6d06-479d-8a70-c72fa48e7c2d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:32.909733 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-965b40b0-6d06-479d-8a70-c72fa48e7c2d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:32.910171 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-965b40b0-6d06-479d-8a70-c72fa48e7c2d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:33.038810 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-965b40b0-6d06-479d-8a70-c72fa48e7c2d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:33.046289 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-965b40b0-6d06-479d-8a70-c72fa48e7c2d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1363 microversion: 2.1 time: 0.148733 Jan 28 01:05:33.046865 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 475/914] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:32 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:33.715019 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4f5cbcb5-83db-4a10-8b48-e35c96dc7177 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:33.715730 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4f5cbcb5-83db-4a10-8b48-e35c96dc7177 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:33.722124 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f5cbcb5-83db-4a10-8b48-e35c96dc7177 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:33.722582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f5cbcb5-83db-4a10-8b48-e35c96dc7177 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:33.723394 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f5cbcb5-83db-4a10-8b48-e35c96dc7177 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:33.723840 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f5cbcb5-83db-4a10-8b48-e35c96dc7177 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:33.855035 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4f5cbcb5-83db-4a10-8b48-e35c96dc7177 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:33.862314 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4f5cbcb5-83db-4a10-8b48-e35c96dc7177 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1510 microversion: 2.1 time: 0.151756 Jan 28 01:05:33.862902 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 440/915] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:33 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:33.878167 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-245991d7-6bfa-446c-b46f-13b0083d0f45 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:33.878743 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-245991d7-6bfa-446c-b46f-13b0083d0f45 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:33.885060 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-245991d7-6bfa-446c-b46f-13b0083d0f45 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:33.885521 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-245991d7-6bfa-446c-b46f-13b0083d0f45 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:33.886304 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-245991d7-6bfa-446c-b46f-13b0083d0f45 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:33.886744 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-245991d7-6bfa-446c-b46f-13b0083d0f45 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:34.063676 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f53347c5-8942-49ce-8c7d-74118b0532ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:34.064254 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f53347c5-8942-49ce-8c7d-74118b0532ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:34.070866 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f53347c5-8942-49ce-8c7d-74118b0532ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:34.071344 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f53347c5-8942-49ce-8c7d-74118b0532ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:34.072140 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f53347c5-8942-49ce-8c7d-74118b0532ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:34.072586 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f53347c5-8942-49ce-8c7d-74118b0532ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:34.109699 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-245991d7-6bfa-446c-b46f-13b0083d0f45 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "POST /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a/action" status: 202 len: 0 microversion: 2.1 time: 0.235013 Jan 28 01:05:34.110629 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 476/916] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:33 2022] POST /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:05:34.118610 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-71bcb738-223a-44cd-9d75-85867cc13158 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:34.118610 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-71bcb738-223a-44cd-9d75-85867cc13158 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:34.124577 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-71bcb738-223a-44cd-9d75-85867cc13158 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:34.125044 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-71bcb738-223a-44cd-9d75-85867cc13158 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:34.125838 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-71bcb738-223a-44cd-9d75-85867cc13158 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:34.126280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-71bcb738-223a-44cd-9d75-85867cc13158 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:34.246403 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f53347c5-8942-49ce-8c7d-74118b0532ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:34.254793 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f53347c5-8942-49ce-8c7d-74118b0532ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1363 microversion: 2.1 time: 0.194795 Jan 28 01:05:34.255871 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 441/917] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:34 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:05:34.276515 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-71bcb738-223a-44cd-9d75-85867cc13158 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:34.285061 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-71bcb738-223a-44cd-9d75-85867cc13158 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1518 microversion: 2.1 time: 0.170642 Jan 28 01:05:34.285774 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 477/918] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:34 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:05:35.064044 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-17d523f7-6834-4d28-90c4-8feb3fb471e8 req-4a0d9e2e-14d5-429f-beaf-91c0284c21ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1", "name": "network-vif-plugged", "status": "completed", "tag": "28f0f27c-c64c-4ac9-a0d2-a2f7ab1a672c"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:35.065721 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:35.065721 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:05:35.074110 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-17d523f7-6834-4d28-90c4-8feb3fb471e8 req-4a0d9e2e-14d5-429f-beaf-91c0284c21ed service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:35.074797 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-17d523f7-6834-4d28-90c4-8feb3fb471e8 req-4a0d9e2e-14d5-429f-beaf-91c0284c21ed service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:35.086054 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-17d523f7-6834-4d28-90c4-8feb3fb471e8 req-4a0d9e2e-14d5-429f-beaf-91c0284c21ed service nova] Creating event network-vif-plugged:28f0f27c-c64c-4ac9-a0d2-a2f7ab1a672c for instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 on hv-cinder-81689 Jan 28 01:05:35.091048 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-17d523f7-6834-4d28-90c4-8feb3fb471e8 req-4a0d9e2e-14d5-429f-beaf-91c0284c21ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030565 Jan 28 01:05:35.091651 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 442/919] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:35.273199 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-96cfa195-4c8c-457a-91d8-5057b81cd4f1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:35.273818 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-96cfa195-4c8c-457a-91d8-5057b81cd4f1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:35.287279 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-96cfa195-4c8c-457a-91d8-5057b81cd4f1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:35.288377 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-96cfa195-4c8c-457a-91d8-5057b81cd4f1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:35.289683 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-96cfa195-4c8c-457a-91d8-5057b81cd4f1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:35.293212 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-96cfa195-4c8c-457a-91d8-5057b81cd4f1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:35.302166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f6f9de44-55f6-4078-9504-a59fe386ec6e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:35.303001 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f6f9de44-55f6-4078-9504-a59fe386ec6e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:35.310162 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f6f9de44-55f6-4078-9504-a59fe386ec6e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:35.310849 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f6f9de44-55f6-4078-9504-a59fe386ec6e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:35.311831 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f6f9de44-55f6-4078-9504-a59fe386ec6e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:35.312460 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f6f9de44-55f6-4078-9504-a59fe386ec6e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:35.457120 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-96cfa195-4c8c-457a-91d8-5057b81cd4f1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:35.465125 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-96cfa195-4c8c-457a-91d8-5057b81cd4f1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1363 microversion: 2.1 time: 0.196055 Jan 28 01:05:35.465674 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 478/920] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:35 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:35.495496 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f6f9de44-55f6-4078-9504-a59fe386ec6e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:35.503091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f6f9de44-55f6-4078-9504-a59fe386ec6e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1520 microversion: 2.1 time: 0.204968 Jan 28 01:05:35.503671 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 443/921] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:35 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:05:36.481835 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a7cf77bc-d7ba-43d4-bb00-16c87cfabde0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:36.482452 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a7cf77bc-d7ba-43d4-bb00-16c87cfabde0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:36.488759 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a7cf77bc-d7ba-43d4-bb00-16c87cfabde0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:36.489217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a7cf77bc-d7ba-43d4-bb00-16c87cfabde0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:36.490011 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a7cf77bc-d7ba-43d4-bb00-16c87cfabde0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:36.490451 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a7cf77bc-d7ba-43d4-bb00-16c87cfabde0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:36.528803 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7623bfbe-2e7c-4609-89ba-b71044d8df35 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:36.529569 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7623bfbe-2e7c-4609-89ba-b71044d8df35 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:36.536528 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7623bfbe-2e7c-4609-89ba-b71044d8df35 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:36.538177 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7623bfbe-2e7c-4609-89ba-b71044d8df35 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:36.539292 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7623bfbe-2e7c-4609-89ba-b71044d8df35 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:36.539844 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7623bfbe-2e7c-4609-89ba-b71044d8df35 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:36.624345 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a7cf77bc-d7ba-43d4-bb00-16c87cfabde0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:36.632520 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a7cf77bc-d7ba-43d4-bb00-16c87cfabde0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1363 microversion: 2.1 time: 0.154192 Jan 28 01:05:36.633114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 479/922] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:36 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:37.005717 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7623bfbe-2e7c-4609-89ba-b71044d8df35 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:37.013321 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7623bfbe-2e7c-4609-89ba-b71044d8df35 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.495536 Jan 28 01:05:37.013895 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 444/923] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:36 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:05:37.107046 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-478c169e-d047-4693-9e68-3cfc3253e3c9 req-b8727388-9d85-47a1-85f4-f7148fa35a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e78861-36ac-4839-a201-ad85a067439a", "name": "network-vif-unplugged", "status": "completed", "tag": "2bcf2856-230f-406e-be0e-7ecdcc4a3436"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:37.108583 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:37.108583 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:05:37.116011 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-478c169e-d047-4693-9e68-3cfc3253e3c9 req-b8727388-9d85-47a1-85f4-f7148fa35a87 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:37.116471 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-478c169e-d047-4693-9e68-3cfc3253e3c9 req-b8727388-9d85-47a1-85f4-f7148fa35a87 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:37.127188 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-478c169e-d047-4693-9e68-3cfc3253e3c9 req-b8727388-9d85-47a1-85f4-f7148fa35a87 service nova] Creating event network-vif-unplugged:2bcf2856-230f-406e-be0e-7ecdcc4a3436 for instance 47e78861-36ac-4839-a201-ad85a067439a on hv-cinder-81689 Jan 28 01:05:37.132375 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-478c169e-d047-4693-9e68-3cfc3253e3c9 req-b8727388-9d85-47a1-85f4-f7148fa35a87 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028723 Jan 28 01:05:37.133217 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 480/924] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:37.655609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-fa525ab1-22e0-4385-8ee8-4f85cdc443d6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:37.656166 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-fa525ab1-22e0-4385-8ee8-4f85cdc443d6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:37.663099 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fa525ab1-22e0-4385-8ee8-4f85cdc443d6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:37.663560 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fa525ab1-22e0-4385-8ee8-4f85cdc443d6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:37.664345 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fa525ab1-22e0-4385-8ee8-4f85cdc443d6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:37.664781 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fa525ab1-22e0-4385-8ee8-4f85cdc443d6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:37.792463 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-fa525ab1-22e0-4385-8ee8-4f85cdc443d6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:37.799853 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-fa525ab1-22e0-4385-8ee8-4f85cdc443d6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1549 microversion: 2.1 time: 0.148394 Jan 28 01:05:37.800420 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 445/925] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:37 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:37.816016 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5d74c81f-8e6c-4682-952d-c1af3eba7ddc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:37.816598 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5d74c81f-8e6c-4682-952d-c1af3eba7ddc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:37.823590 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d74c81f-8e6c-4682-952d-c1af3eba7ddc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:37.824039 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d74c81f-8e6c-4682-952d-c1af3eba7ddc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:37.824823 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d74c81f-8e6c-4682-952d-c1af3eba7ddc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:37.825261 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5d74c81f-8e6c-4682-952d-c1af3eba7ddc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:37.906302 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5d74c81f-8e6c-4682-952d-c1af3eba7ddc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094125 Jan 28 01:05:37.906844 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 481/926] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jan 28 01:05:37 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:38.029879 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8f0e8e6a-74c8-4831-be5b-717a6fbe9c7a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:38.030663 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8f0e8e6a-74c8-4831-be5b-717a6fbe9c7a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:38.036547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8f0e8e6a-74c8-4831-be5b-717a6fbe9c7a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:38.037015 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8f0e8e6a-74c8-4831-be5b-717a6fbe9c7a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:38.037818 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8f0e8e6a-74c8-4831-be5b-717a6fbe9c7a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:38.038265 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8f0e8e6a-74c8-4831-be5b-717a6fbe9c7a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:38.181648 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8f0e8e6a-74c8-4831-be5b-717a6fbe9c7a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:38.189246 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8f0e8e6a-74c8-4831-be5b-717a6fbe9c7a tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.163170 Jan 28 01:05:38.189816 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 446/927] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:38 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:38.883560 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d1a021fa-b014-433b-8ebf-6833104256e4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:38.884463 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d1a021fa-b014-433b-8ebf-6833104256e4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:38.891094 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-94221649-fd61-4a0a-8370-419f3ffa482e req-0e1530a0-b86c-4ca9-a250-c99ad8db0a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1", "tag": "28f0f27c-c64c-4ac9-a0d2-a2f7ab1a672c"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:38.891697 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1a021fa-b014-433b-8ebf-6833104256e4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:38.891955 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1a021fa-b014-433b-8ebf-6833104256e4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:38.892652 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:38.892652 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:05:38.892825 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1a021fa-b014-433b-8ebf-6833104256e4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:38.893742 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d1a021fa-b014-433b-8ebf-6833104256e4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:38.900045 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-94221649-fd61-4a0a-8370-419f3ffa482e req-0e1530a0-b86c-4ca9-a250-c99ad8db0a24 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:38.900501 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-94221649-fd61-4a0a-8370-419f3ffa482e req-0e1530a0-b86c-4ca9-a250-c99ad8db0a24 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:38.912257 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-94221649-fd61-4a0a-8370-419f3ffa482e req-0e1530a0-b86c-4ca9-a250-c99ad8db0a24 service nova] Creating event network-changed:28f0f27c-c64c-4ac9-a0d2-a2f7ab1a672c for instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 on hv-cinder-81689 Jan 28 01:05:38.918688 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-94221649-fd61-4a0a-8370-419f3ffa482e req-0e1530a0-b86c-4ca9-a250-c99ad8db0a24 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030992 Jan 28 01:05:38.919515 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 447/928] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:39.020505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d1a021fa-b014-433b-8ebf-6833104256e4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.141848 Jan 28 01:05:39.021053 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 482/929] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:38 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:39.207050 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-ee0b0516-de83-4768-a537-cae5847743da tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:39.207822 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-ee0b0516-de83-4768-a537-cae5847743da tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:39.213897 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ee0b0516-de83-4768-a537-cae5847743da tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:39.214565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ee0b0516-de83-4768-a537-cae5847743da tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:39.215383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ee0b0516-de83-4768-a537-cae5847743da tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:39.215823 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-ee0b0516-de83-4768-a537-cae5847743da tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:39.436977 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-ee0b0516-de83-4768-a537-cae5847743da tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:39.445014 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-ee0b0516-de83-4768-a537-cae5847743da tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.241384 Jan 28 01:05:39.445604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 448/930] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:39 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:40.032110 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9aab49c5-defb-4be8-b93a-36d2931cdd63 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:40.033382 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9aab49c5-defb-4be8-b93a-36d2931cdd63 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:40.040348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9aab49c5-defb-4be8-b93a-36d2931cdd63 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:40.040888 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9aab49c5-defb-4be8-b93a-36d2931cdd63 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:40.041688 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9aab49c5-defb-4be8-b93a-36d2931cdd63 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:40.042133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9aab49c5-defb-4be8-b93a-36d2931cdd63 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:40.129872 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9aab49c5-defb-4be8-b93a-36d2931cdd63 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.101794 Jan 28 01:05:40.130504 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 483/931] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:40 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:40.461453 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-402c261c-6c22-4ad5-a932-55761d10c65d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:40.462072 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-402c261c-6c22-4ad5-a932-55761d10c65d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:40.468843 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-402c261c-6c22-4ad5-a932-55761d10c65d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:40.469300 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-402c261c-6c22-4ad5-a932-55761d10c65d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:40.470133 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-402c261c-6c22-4ad5-a932-55761d10c65d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:40.470575 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-402c261c-6c22-4ad5-a932-55761d10c65d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:40.600568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-402c261c-6c22-4ad5-a932-55761d10c65d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:40.607989 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-402c261c-6c22-4ad5-a932-55761d10c65d tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.150224 Jan 28 01:05:40.608568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 449/932] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:40 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:41.141266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3f569400-4e14-4faf-bdca-e16cdaef0a7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:41.142263 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3f569400-4e14-4faf-bdca-e16cdaef0a7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:41.149156 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3f569400-4e14-4faf-bdca-e16cdaef0a7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:41.149611 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3f569400-4e14-4faf-bdca-e16cdaef0a7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:41.150393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3f569400-4e14-4faf-bdca-e16cdaef0a7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:41.150835 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3f569400-4e14-4faf-bdca-e16cdaef0a7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:41.246193 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3f569400-4e14-4faf-bdca-e16cdaef0a7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.108812 Jan 28 01:05:41.246801 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 484/933] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:41 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:41.625011 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0dc29bd1-45f1-414b-8c7a-13ae229a1ecd tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:41.625630 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0dc29bd1-45f1-414b-8c7a-13ae229a1ecd tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:41.631959 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0dc29bd1-45f1-414b-8c7a-13ae229a1ecd tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:41.632425 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0dc29bd1-45f1-414b-8c7a-13ae229a1ecd tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:41.633200 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0dc29bd1-45f1-414b-8c7a-13ae229a1ecd tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:41.633637 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0dc29bd1-45f1-414b-8c7a-13ae229a1ecd tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:41.764779 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0dc29bd1-45f1-414b-8c7a-13ae229a1ecd tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:41.772656 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0dc29bd1-45f1-414b-8c7a-13ae229a1ecd tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.151509 Jan 28 01:05:41.773217 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 450/934] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:41 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:42.258008 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5ed1272c-60ee-4537-8305-554f40cd42b9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:42.259021 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5ed1272c-60ee-4537-8305-554f40cd42b9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:42.265815 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5ed1272c-60ee-4537-8305-554f40cd42b9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:42.266261 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5ed1272c-60ee-4537-8305-554f40cd42b9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:42.267053 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5ed1272c-60ee-4537-8305-554f40cd42b9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:42.267485 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5ed1272c-60ee-4537-8305-554f40cd42b9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:42.361056 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5ed1272c-60ee-4537-8305-554f40cd42b9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.106805 Jan 28 01:05:42.361601 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 485/935] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:42 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:42.790735 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1e22c5e9-08b0-42c4-837c-e9dd9b840585 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:42.791382 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1e22c5e9-08b0-42c4-837c-e9dd9b840585 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:42.797761 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1e22c5e9-08b0-42c4-837c-e9dd9b840585 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:42.798217 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1e22c5e9-08b0-42c4-837c-e9dd9b840585 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:42.799036 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1e22c5e9-08b0-42c4-837c-e9dd9b840585 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:42.799478 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1e22c5e9-08b0-42c4-837c-e9dd9b840585 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:42.930411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1e22c5e9-08b0-42c4-837c-e9dd9b840585 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:42.938032 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1e22c5e9-08b0-42c4-837c-e9dd9b840585 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.151579 Jan 28 01:05:42.938599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 451/936] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:42 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:43.372984 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3825d73c-6f8c-403e-ae69-ed095161cc99 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:43.373993 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3825d73c-6f8c-403e-ae69-ed095161cc99 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:43.381773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3825d73c-6f8c-403e-ae69-ed095161cc99 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:43.382233 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3825d73c-6f8c-403e-ae69-ed095161cc99 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:43.383079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3825d73c-6f8c-403e-ae69-ed095161cc99 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:43.383523 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3825d73c-6f8c-403e-ae69-ed095161cc99 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:43.475036 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3825d73c-6f8c-403e-ae69-ed095161cc99 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.106092 Jan 28 01:05:43.475690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 486/937] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:43 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:43.955147 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-81c65f41-16e2-41b5-9cf4-7122cb4f8dae tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:43.955764 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-81c65f41-16e2-41b5-9cf4-7122cb4f8dae tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:43.962075 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-81c65f41-16e2-41b5-9cf4-7122cb4f8dae tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:43.962526 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-81c65f41-16e2-41b5-9cf4-7122cb4f8dae tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:43.963335 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-81c65f41-16e2-41b5-9cf4-7122cb4f8dae tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:43.963773 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-81c65f41-16e2-41b5-9cf4-7122cb4f8dae tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:44.095293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-81c65f41-16e2-41b5-9cf4-7122cb4f8dae tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:44.102481 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-81c65f41-16e2-41b5-9cf4-7122cb4f8dae tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.150991 Jan 28 01:05:44.103066 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 452/938] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:43 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:44.486076 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1a52fb7a-f73d-4a5a-99a0-8273bd045a44 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:44.487114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1a52fb7a-f73d-4a5a-99a0-8273bd045a44 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:44.494141 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a52fb7a-f73d-4a5a-99a0-8273bd045a44 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:44.494602 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a52fb7a-f73d-4a5a-99a0-8273bd045a44 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:44.495429 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a52fb7a-f73d-4a5a-99a0-8273bd045a44 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:44.495869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1a52fb7a-f73d-4a5a-99a0-8273bd045a44 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:44.636835 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1a52fb7a-f73d-4a5a-99a0-8273bd045a44 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.154609 Jan 28 01:05:44.637480 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 487/939] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:44 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:45.119876 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-196b123e-b673-4347-9d03-9d5ba8cf35a1 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:45.120492 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-196b123e-b673-4347-9d03-9d5ba8cf35a1 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:45.127961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-196b123e-b673-4347-9d03-9d5ba8cf35a1 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:45.128456 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-196b123e-b673-4347-9d03-9d5ba8cf35a1 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:45.129611 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-196b123e-b673-4347-9d03-9d5ba8cf35a1 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:45.130860 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-196b123e-b673-4347-9d03-9d5ba8cf35a1 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:45.414366 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-196b123e-b673-4347-9d03-9d5ba8cf35a1 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:45.421781 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-196b123e-b673-4347-9d03-9d5ba8cf35a1 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.306077 Jan 28 01:05:45.422346 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 453/940] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:45 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:45.649117 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e97df306-6e7e-4dcb-8f02-32e66f0dd043 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:45.650219 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e97df306-6e7e-4dcb-8f02-32e66f0dd043 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:45.657342 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e97df306-6e7e-4dcb-8f02-32e66f0dd043 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:45.657785 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e97df306-6e7e-4dcb-8f02-32e66f0dd043 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:45.658566 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e97df306-6e7e-4dcb-8f02-32e66f0dd043 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:45.659026 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e97df306-6e7e-4dcb-8f02-32e66f0dd043 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:45.748769 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e97df306-6e7e-4dcb-8f02-32e66f0dd043 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.103712 Jan 28 01:05:45.749618 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 488/941] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:45 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:46.438631 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f88ff7d8-e76a-4930-82d4-f7aa23618cc2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:46.439319 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f88ff7d8-e76a-4930-82d4-f7aa23618cc2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:46.445832 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f88ff7d8-e76a-4930-82d4-f7aa23618cc2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:46.446287 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f88ff7d8-e76a-4930-82d4-f7aa23618cc2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:46.447111 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f88ff7d8-e76a-4930-82d4-f7aa23618cc2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:46.447548 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f88ff7d8-e76a-4930-82d4-f7aa23618cc2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:46.595655 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-f88ff7d8-e76a-4930-82d4-f7aa23618cc2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:46.603701 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f88ff7d8-e76a-4930-82d4-f7aa23618cc2 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.168827 Jan 28 01:05:46.604273 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 454/942] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:46 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:46.760996 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f1a3b74a-2bc4-4539-965b-b120291d64ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:46.762026 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f1a3b74a-2bc4-4539-965b-b120291d64ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:46.769328 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f1a3b74a-2bc4-4539-965b-b120291d64ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:46.769786 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f1a3b74a-2bc4-4539-965b-b120291d64ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:46.770599 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f1a3b74a-2bc4-4539-965b-b120291d64ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:46.771072 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f1a3b74a-2bc4-4539-965b-b120291d64ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:46.863916 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f1a3b74a-2bc4-4539-965b-b120291d64ed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.106766 Jan 28 01:05:46.864552 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 489/943] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:46 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:47.116117 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-ea9a4b1f-b04f-4fee-afc5-f5dc7f449282 req-bf725b78-88dd-41f2-9082-39ad7184d285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e78861-36ac-4839-a201-ad85a067439a", "name": "network-vif-plugged", "status": "completed", "tag": "2bcf2856-230f-406e-be0e-7ecdcc4a3436"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:47.117674 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:47.117674 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:05:47.127193 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-ea9a4b1f-b04f-4fee-afc5-f5dc7f449282 req-bf725b78-88dd-41f2-9082-39ad7184d285 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:47.127654 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-ea9a4b1f-b04f-4fee-afc5-f5dc7f449282 req-bf725b78-88dd-41f2-9082-39ad7184d285 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:47.140179 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-ea9a4b1f-b04f-4fee-afc5-f5dc7f449282 req-bf725b78-88dd-41f2-9082-39ad7184d285 service nova] Creating event network-vif-plugged:2bcf2856-230f-406e-be0e-7ecdcc4a3436 for instance 47e78861-36ac-4839-a201-ad85a067439a on hv-cinder-81689 Jan 28 01:05:47.145639 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-ea9a4b1f-b04f-4fee-afc5-f5dc7f449282 req-bf725b78-88dd-41f2-9082-39ad7184d285 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032751 Jan 28 01:05:47.146259 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 455/944] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:47.621040 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-47ac1465-579d-4c71-9199-501ea457024e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:47.621790 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-47ac1465-579d-4c71-9199-501ea457024e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:47.628950 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47ac1465-579d-4c71-9199-501ea457024e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:47.629408 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47ac1465-579d-4c71-9199-501ea457024e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:47.630211 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47ac1465-579d-4c71-9199-501ea457024e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:47.630654 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-47ac1465-579d-4c71-9199-501ea457024e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:47.764485 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-47ac1465-579d-4c71-9199-501ea457024e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:47.771994 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-47ac1465-579d-4c71-9199-501ea457024e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1576 microversion: 2.1 time: 0.155025 Jan 28 01:05:47.772565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 490/945] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:47 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:47.880079 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-246e74bf-cb76-4fc0-9d1a-7d182679e2b3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:47.881668 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-246e74bf-cb76-4fc0-9d1a-7d182679e2b3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:47.888277 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-246e74bf-cb76-4fc0-9d1a-7d182679e2b3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:47.888736 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-246e74bf-cb76-4fc0-9d1a-7d182679e2b3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:47.889530 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-246e74bf-cb76-4fc0-9d1a-7d182679e2b3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:47.889974 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-246e74bf-cb76-4fc0-9d1a-7d182679e2b3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:48.005730 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-246e74bf-cb76-4fc0-9d1a-7d182679e2b3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.134212 Jan 28 01:05:48.006951 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 456/946] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:47 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:48.793603 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a6450427-d862-4ade-bd40-4cb41d31f20c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:48.794514 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a6450427-d862-4ade-bd40-4cb41d31f20c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:48.803639 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a6450427-d862-4ade-bd40-4cb41d31f20c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:48.804097 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a6450427-d862-4ade-bd40-4cb41d31f20c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:48.804929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a6450427-d862-4ade-bd40-4cb41d31f20c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:48.805665 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a6450427-d862-4ade-bd40-4cb41d31f20c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:48.948413 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a6450427-d862-4ade-bd40-4cb41d31f20c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:48.957640 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a6450427-d862-4ade-bd40-4cb41d31f20c tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1563 microversion: 2.1 time: 0.171938 Jan 28 01:05:48.958232 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 491/947] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:48 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:05:49.017688 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e9c17e1e-c407-4563-b9a2-adee5b47e55e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:49.018716 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e9c17e1e-c407-4563-b9a2-adee5b47e55e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:49.026544 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9c17e1e-c407-4563-b9a2-adee5b47e55e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:49.027018 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9c17e1e-c407-4563-b9a2-adee5b47e55e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:49.027943 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9c17e1e-c407-4563-b9a2-adee5b47e55e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:49.028743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e9c17e1e-c407-4563-b9a2-adee5b47e55e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:49.150975 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e9c17e1e-c407-4563-b9a2-adee5b47e55e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.137114 Jan 28 01:05:49.151848 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 457/948] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:49 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:50.161561 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-acac57f3-27d2-40ac-a413-94a2522c7bb7 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:50.162496 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-acac57f3-27d2-40ac-a413-94a2522c7bb7 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:50.168750 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acac57f3-27d2-40ac-a413-94a2522c7bb7 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:50.169193 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acac57f3-27d2-40ac-a413-94a2522c7bb7 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:50.169990 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acac57f3-27d2-40ac-a413-94a2522c7bb7 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:50.170425 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acac57f3-27d2-40ac-a413-94a2522c7bb7 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:50.287691 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-acac57f3-27d2-40ac-a413-94a2522c7bb7 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 14 microversion: 2.1 time: 0.128976 Jan 28 01:05:50.288233 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 492/949] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:50 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:05:51.298670 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2f1e962e-a85c-429a-8181-efadf6893e10 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:51.299730 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2f1e962e-a85c-429a-8181-efadf6893e10 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:51.307457 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f1e962e-a85c-429a-8181-efadf6893e10 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:51.307915 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f1e962e-a85c-429a-8181-efadf6893e10 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:51.308717 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f1e962e-a85c-429a-8181-efadf6893e10 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:51.309168 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f1e962e-a85c-429a-8181-efadf6893e10 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:51.412754 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2f1e962e-a85c-429a-8181-efadf6893e10 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 9182 microversion: 2.1 time: 0.117431 Jan 28 01:05:51.413406 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 458/950] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:51 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 9182 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:52.424738 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6902a4a0-5af8-4f0a-8efa-2c33cedd1652 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:52.425687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6902a4a0-5af8-4f0a-8efa-2c33cedd1652 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:52.432801 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6902a4a0-5af8-4f0a-8efa-2c33cedd1652 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:52.433259 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6902a4a0-5af8-4f0a-8efa-2c33cedd1652 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:52.434050 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6902a4a0-5af8-4f0a-8efa-2c33cedd1652 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:52.434492 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6902a4a0-5af8-4f0a-8efa-2c33cedd1652 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:52.533822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6902a4a0-5af8-4f0a-8efa-2c33cedd1652 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 15145 microversion: 2.1 time: 0.112978 Jan 28 01:05:52.534469 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 493/951] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:52 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 15145 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:05:53.546223 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1fb6df9d-9b54-4edc-8bbc-eb49dca78590 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:53.547209 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1fb6df9d-9b54-4edc-8bbc-eb49dca78590 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:53.554593 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fb6df9d-9b54-4edc-8bbc-eb49dca78590 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:53.555072 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fb6df9d-9b54-4edc-8bbc-eb49dca78590 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:53.555855 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fb6df9d-9b54-4edc-8bbc-eb49dca78590 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:53.556295 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1fb6df9d-9b54-4edc-8bbc-eb49dca78590 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:53.651534 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1fb6df9d-9b54-4edc-8bbc-eb49dca78590 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 18303 microversion: 2.1 time: 0.109246 Jan 28 01:05:53.652197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 459/952] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:53 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 18303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:05:54.664336 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3a2bb43d-e661-4774-a41c-6deb165b52b8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:54.665334 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3a2bb43d-e661-4774-a41c-6deb165b52b8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:54.672246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a2bb43d-e661-4774-a41c-6deb165b52b8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:54.672703 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a2bb43d-e661-4774-a41c-6deb165b52b8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:54.673490 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a2bb43d-e661-4774-a41c-6deb165b52b8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:54.673934 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3a2bb43d-e661-4774-a41c-6deb165b52b8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:54.783019 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3a2bb43d-e661-4774-a41c-6deb165b52b8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 19342 microversion: 2.1 time: 0.123169 Jan 28 01:05:54.783642 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 494/953] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:54 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 19342 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:05:55.794893 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6e576978-52da-4ad5-8702-d381c74aeabe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:55.795954 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6e576978-52da-4ad5-8702-d381c74aeabe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:55.803291 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6e576978-52da-4ad5-8702-d381c74aeabe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:55.803747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6e576978-52da-4ad5-8702-d381c74aeabe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:55.804529 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6e576978-52da-4ad5-8702-d381c74aeabe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:55.804964 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6e576978-52da-4ad5-8702-d381c74aeabe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:55.903339 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6e576978-52da-4ad5-8702-d381c74aeabe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 21935 microversion: 2.1 time: 0.111981 Jan 28 01:05:55.903943 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 460/954] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:55 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 21935 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:05:56.915078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5629d0b7-ec77-401d-8d7e-241f2588582e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:56.916071 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5629d0b7-ec77-401d-8d7e-241f2588582e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:56.922868 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5629d0b7-ec77-401d-8d7e-241f2588582e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:56.923371 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5629d0b7-ec77-401d-8d7e-241f2588582e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:56.924168 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5629d0b7-ec77-401d-8d7e-241f2588582e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:56.924600 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5629d0b7-ec77-401d-8d7e-241f2588582e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:57.034122 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5629d0b7-ec77-401d-8d7e-241f2588582e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 23228 microversion: 2.1 time: 0.122912 Jan 28 01:05:57.034766 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 495/955] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:56 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 23228 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:05:58.046266 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-777d4fb6-7c17-4ceb-8d1c-064c65566c42 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:58.047301 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-777d4fb6-7c17-4ceb-8d1c-064c65566c42 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:58.054362 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-777d4fb6-7c17-4ceb-8d1c-064c65566c42 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:58.054807 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-777d4fb6-7c17-4ceb-8d1c-064c65566c42 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:58.055625 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-777d4fb6-7c17-4ceb-8d1c-064c65566c42 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:58.056064 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-777d4fb6-7c17-4ceb-8d1c-064c65566c42 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:58.149108 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-777d4fb6-7c17-4ceb-8d1c-064c65566c42 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 24302 microversion: 2.1 time: 0.106829 Jan 28 01:05:58.149750 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 461/956] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:58 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 24302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:05:59.166262 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c7f8e1ff-ee9f-47fb-9c8b-9e6487840d3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:59.168040 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c7f8e1ff-ee9f-47fb-9c8b-9e6487840d3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:59.180519 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7f8e1ff-ee9f-47fb-9c8b-9e6487840d3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:59.181312 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7f8e1ff-ee9f-47fb-9c8b-9e6487840d3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:59.182685 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7f8e1ff-ee9f-47fb-9c8b-9e6487840d3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:59.183494 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c7f8e1ff-ee9f-47fb-9c8b-9e6487840d3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:59.291856 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c7f8e1ff-ee9f-47fb-9c8b-9e6487840d3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 25844 microversion: 2.1 time: 0.133087 Jan 28 01:05:59.292512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 496/957] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:59 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 25844 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:00.304872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1112d391-bdc8-4944-adcf-d5d19fed9c15 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:00.305885 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1112d391-bdc8-4944-adcf-d5d19fed9c15 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:00.312860 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1112d391-bdc8-4944-adcf-d5d19fed9c15 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:00.313309 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1112d391-bdc8-4944-adcf-d5d19fed9c15 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:00.314124 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1112d391-bdc8-4944-adcf-d5d19fed9c15 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:00.314564 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1112d391-bdc8-4944-adcf-d5d19fed9c15 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:00.436346 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1112d391-bdc8-4944-adcf-d5d19fed9c15 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 26829 microversion: 2.1 time: 0.135283 Jan 28 01:06:00.436988 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 462/958] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:00 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 26829 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:01.448921 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b280a271-7ad3-4a58-ad9b-f602a697c8bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:01.449931 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b280a271-7ad3-4a58-ad9b-f602a697c8bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:01.456910 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b280a271-7ad3-4a58-ad9b-f602a697c8bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:01.457368 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b280a271-7ad3-4a58-ad9b-f602a697c8bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:01.458160 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b280a271-7ad3-4a58-ad9b-f602a697c8bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:01.458650 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b280a271-7ad3-4a58-ad9b-f602a697c8bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:01.558719 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b280a271-7ad3-4a58-ad9b-f602a697c8bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 27514 microversion: 2.1 time: 0.113563 Jan 28 01:06:01.559294 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 497/959] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:01 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 27514 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:02.571572 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5ae43bbd-d729-411e-828c-3e85f9062dc2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:02.572471 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5ae43bbd-d729-411e-828c-3e85f9062dc2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:02.579311 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5ae43bbd-d729-411e-828c-3e85f9062dc2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:02.579761 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5ae43bbd-d729-411e-828c-3e85f9062dc2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:02.580540 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5ae43bbd-d729-411e-828c-3e85f9062dc2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:02.580975 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5ae43bbd-d729-411e-828c-3e85f9062dc2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:02.682274 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5ae43bbd-d729-411e-828c-3e85f9062dc2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 27931 microversion: 2.1 time: 0.115346 Jan 28 01:06:02.682917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 463/960] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:02 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 27931 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:03.248181 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:06:03.248433 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: Fri Jan 28 01:06:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:06:03.694739 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a80d7373-dc04-4271-bd53-28cd03385bf3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:03.695713 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a80d7373-dc04-4271-bd53-28cd03385bf3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:03.703712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a80d7373-dc04-4271-bd53-28cd03385bf3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:03.704171 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a80d7373-dc04-4271-bd53-28cd03385bf3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:03.704958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a80d7373-dc04-4271-bd53-28cd03385bf3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:03.705400 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a80d7373-dc04-4271-bd53-28cd03385bf3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:03.810617 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a80d7373-dc04-4271-bd53-28cd03385bf3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 28185 microversion: 2.1 time: 0.120484 Jan 28 01:06:03.811286 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 498/961] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:03 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 28185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:04.822999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-35416cbb-1f34-47f4-9c48-7c6379383276 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:04.823998 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-35416cbb-1f34-47f4-9c48-7c6379383276 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:04.830711 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35416cbb-1f34-47f4-9c48-7c6379383276 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:04.831181 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35416cbb-1f34-47f4-9c48-7c6379383276 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:04.831970 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35416cbb-1f34-47f4-9c48-7c6379383276 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:04.832409 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-35416cbb-1f34-47f4-9c48-7c6379383276 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:04.937599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-35416cbb-1f34-47f4-9c48-7c6379383276 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 28185 microversion: 2.1 time: 0.118412 Jan 28 01:06:04.938493 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 464/962] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:04 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 28185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:05.949497 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-90ac1546-e350-4fb4-b4a4-8b74a86dc742 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:05.950494 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-90ac1546-e350-4fb4-b4a4-8b74a86dc742 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:05.957592 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-90ac1546-e350-4fb4-b4a4-8b74a86dc742 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:05.958047 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-90ac1546-e350-4fb4-b4a4-8b74a86dc742 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:05.959363 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-90ac1546-e350-4fb4-b4a4-8b74a86dc742 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:05.959808 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-90ac1546-e350-4fb4-b4a4-8b74a86dc742 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:06.054184 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-90ac1546-e350-4fb4-b4a4-8b74a86dc742 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 28476 microversion: 2.1 time: 0.108574 Jan 28 01:06:06.054819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 499/963] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:05 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 28476 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:07.067466 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-50c65aaa-4883-47b0-9718-678a2fbc95ee tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:07.068958 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-50c65aaa-4883-47b0-9718-678a2fbc95ee tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:07.075967 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-50c65aaa-4883-47b0-9718-678a2fbc95ee tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:07.076602 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-50c65aaa-4883-47b0-9718-678a2fbc95ee tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:07.077762 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-50c65aaa-4883-47b0-9718-678a2fbc95ee tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:07.078380 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-50c65aaa-4883-47b0-9718-678a2fbc95ee tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:07.189586 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-50c65aaa-4883-47b0-9718-678a2fbc95ee tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 28644 microversion: 2.1 time: 0.127810 Jan 28 01:06:07.190260 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 465/964] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:07 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 28644 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:08.201996 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-73250790-bbff-4eb2-9ea1-81a3624a6370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:08.203009 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-73250790-bbff-4eb2-9ea1-81a3624a6370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:08.210410 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73250790-bbff-4eb2-9ea1-81a3624a6370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:08.210861 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73250790-bbff-4eb2-9ea1-81a3624a6370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:08.211665 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73250790-bbff-4eb2-9ea1-81a3624a6370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:08.212102 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-73250790-bbff-4eb2-9ea1-81a3624a6370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:08.313107 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-73250790-bbff-4eb2-9ea1-81a3624a6370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 28644 microversion: 2.1 time: 0.114976 Jan 28 01:06:08.313751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 500/965] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:08 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 28644 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:09.325499 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c76978d7-ee2d-42aa-94f0-42d82d553025 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:09.326600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c76978d7-ee2d-42aa-94f0-42d82d553025 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:09.333452 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c76978d7-ee2d-42aa-94f0-42d82d553025 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:09.334443 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c76978d7-ee2d-42aa-94f0-42d82d553025 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:09.335246 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c76978d7-ee2d-42aa-94f0-42d82d553025 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:09.335677 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c76978d7-ee2d-42aa-94f0-42d82d553025 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:09.425983 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c76978d7-ee2d-42aa-94f0-42d82d553025 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 28644 microversion: 2.1 time: 0.104366 Jan 28 01:06:09.426648 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 466/966] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:09 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 28644 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:10.439147 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1b878202-1cae-42e2-b7d3-dc5d85d2e731 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:10.440133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1b878202-1cae-42e2-b7d3-dc5d85d2e731 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:10.447614 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1b878202-1cae-42e2-b7d3-dc5d85d2e731 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:10.448066 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1b878202-1cae-42e2-b7d3-dc5d85d2e731 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:10.448854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1b878202-1cae-42e2-b7d3-dc5d85d2e731 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:10.449300 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1b878202-1cae-42e2-b7d3-dc5d85d2e731 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:10.534150 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1b878202-1cae-42e2-b7d3-dc5d85d2e731 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 28644 microversion: 2.1 time: 0.099048 Jan 28 01:06:10.535540 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 501/967] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:10 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 28644 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:11.547474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-27621e64-a76d-41ad-8433-226a4a1aad3f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:11.548542 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-27621e64-a76d-41ad-8433-226a4a1aad3f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:11.555382 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-27621e64-a76d-41ad-8433-226a4a1aad3f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:11.555841 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-27621e64-a76d-41ad-8433-226a4a1aad3f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:11.556670 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-27621e64-a76d-41ad-8433-226a4a1aad3f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:11.557115 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-27621e64-a76d-41ad-8433-226a4a1aad3f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:11.658868 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-27621e64-a76d-41ad-8433-226a4a1aad3f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 29936 microversion: 2.1 time: 0.115294 Jan 28 01:06:11.659550 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 467/968] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:11 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 29936 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:12.671955 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-cb818d6b-d6b6-423e-94e4-27fbffb30cce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:12.672965 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-cb818d6b-d6b6-423e-94e4-27fbffb30cce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:12.680508 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cb818d6b-d6b6-423e-94e4-27fbffb30cce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:12.680958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cb818d6b-d6b6-423e-94e4-27fbffb30cce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:12.681746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cb818d6b-d6b6-423e-94e4-27fbffb30cce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:12.682180 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-cb818d6b-d6b6-423e-94e4-27fbffb30cce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:12.805069 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-cb818d6b-d6b6-423e-94e4-27fbffb30cce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 31767 microversion: 2.1 time: 0.137159 Jan 28 01:06:12.805712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 502/969] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:12 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 31767 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:13.817183 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5801318d-57da-48a3-8ce0-fbb6e83d314d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:13.818686 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5801318d-57da-48a3-8ce0-fbb6e83d314d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:13.825545 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5801318d-57da-48a3-8ce0-fbb6e83d314d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:13.825999 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5801318d-57da-48a3-8ce0-fbb6e83d314d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:13.826785 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5801318d-57da-48a3-8ce0-fbb6e83d314d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:13.827251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5801318d-57da-48a3-8ce0-fbb6e83d314d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:13.969637 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5801318d-57da-48a3-8ce0-fbb6e83d314d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 32912 microversion: 2.1 time: 0.156333 Jan 28 01:06:13.970277 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 468/970] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:13 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 32912 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:14.981897 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1902eff3-53a9-41d1-988e-681555af1b7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:14.982929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1902eff3-53a9-41d1-988e-681555af1b7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:14.990375 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1902eff3-53a9-41d1-988e-681555af1b7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:14.990835 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1902eff3-53a9-41d1-988e-681555af1b7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:14.991664 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1902eff3-53a9-41d1-988e-681555af1b7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:14.992106 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1902eff3-53a9-41d1-988e-681555af1b7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:15.093181 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1902eff3-53a9-41d1-988e-681555af1b7d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 33689 microversion: 2.1 time: 0.115246 Jan 28 01:06:15.093836 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 503/971] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:14 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 33689 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:16.105780 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1b7d7146-7be6-4693-b8c5-5ccd8a620be5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:16.106804 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1b7d7146-7be6-4693-b8c5-5ccd8a620be5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:16.118264 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1b7d7146-7be6-4693-b8c5-5ccd8a620be5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:16.118717 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1b7d7146-7be6-4693-b8c5-5ccd8a620be5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:16.119630 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1b7d7146-7be6-4693-b8c5-5ccd8a620be5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:16.120001 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1b7d7146-7be6-4693-b8c5-5ccd8a620be5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:16.218712 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1b7d7146-7be6-4693-b8c5-5ccd8a620be5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 34756 microversion: 2.1 time: 0.116729 Jan 28 01:06:16.219390 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 469/972] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:16 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 34756 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:17.232659 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4dcf67c9-068f-428e-a3fd-ffee4184e327 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:17.233665 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4dcf67c9-068f-428e-a3fd-ffee4184e327 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:17.240680 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4dcf67c9-068f-428e-a3fd-ffee4184e327 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:17.241133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4dcf67c9-068f-428e-a3fd-ffee4184e327 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:17.241955 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4dcf67c9-068f-428e-a3fd-ffee4184e327 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:17.242920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4dcf67c9-068f-428e-a3fd-ffee4184e327 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:17.341218 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4dcf67c9-068f-428e-a3fd-ffee4184e327 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 35713 microversion: 2.1 time: 0.112361 Jan 28 01:06:17.341883 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 504/973] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:17 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 35713 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:18.353395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-11a8ebc5-6a45-4a2a-914e-5d3847870fd5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:18.354404 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-11a8ebc5-6a45-4a2a-914e-5d3847870fd5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:18.361420 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-11a8ebc5-6a45-4a2a-914e-5d3847870fd5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:18.361884 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-11a8ebc5-6a45-4a2a-914e-5d3847870fd5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:18.362679 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-11a8ebc5-6a45-4a2a-914e-5d3847870fd5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:18.363150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-11a8ebc5-6a45-4a2a-914e-5d3847870fd5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:18.456543 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-11a8ebc5-6a45-4a2a-914e-5d3847870fd5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 37232 microversion: 2.1 time: 0.107045 Jan 28 01:06:18.457224 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 470/974] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:18 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 37232 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:19.469148 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f5b8b617-dc1a-494c-8e00-e37b6080d939 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:19.470185 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f5b8b617-dc1a-494c-8e00-e37b6080d939 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:19.477122 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5b8b617-dc1a-494c-8e00-e37b6080d939 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:19.477577 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5b8b617-dc1a-494c-8e00-e37b6080d939 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:19.478367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5b8b617-dc1a-494c-8e00-e37b6080d939 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:19.478807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f5b8b617-dc1a-494c-8e00-e37b6080d939 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:19.584647 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f5b8b617-dc1a-494c-8e00-e37b6080d939 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 38174 microversion: 2.1 time: 0.119580 Jan 28 01:06:19.585295 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 505/975] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:19 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 38174 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:20.597669 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b4633db0-ca79-4a17-8891-6747ab234370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:20.598677 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b4633db0-ca79-4a17-8891-6747ab234370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:20.606216 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b4633db0-ca79-4a17-8891-6747ab234370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:20.606667 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b4633db0-ca79-4a17-8891-6747ab234370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:20.607491 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b4633db0-ca79-4a17-8891-6747ab234370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:20.607924 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b4633db0-ca79-4a17-8891-6747ab234370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:20.707776 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b4633db0-ca79-4a17-8891-6747ab234370 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 38174 microversion: 2.1 time: 0.114366 Jan 28 01:06:20.708954 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 471/976] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:20 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 38174 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:06:21.720588 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-74e1d1fe-06d6-49d0-b3b3-94983095e5f3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:21.721585 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-74e1d1fe-06d6-49d0-b3b3-94983095e5f3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:21.729112 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-74e1d1fe-06d6-49d0-b3b3-94983095e5f3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:21.729564 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-74e1d1fe-06d6-49d0-b3b3-94983095e5f3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:21.730351 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-74e1d1fe-06d6-49d0-b3b3-94983095e5f3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:21.730787 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-74e1d1fe-06d6-49d0-b3b3-94983095e5f3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:21.818770 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-74e1d1fe-06d6-49d0-b3b3-94983095e5f3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 38174 microversion: 2.1 time: 0.101552 Jan 28 01:06:21.819453 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 506/977] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:21 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 38174 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:22.832540 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-666e1d2d-b255-4e75-93b6-73a58225c5d3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:22.834568 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-666e1d2d-b255-4e75-93b6-73a58225c5d3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:22.841267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-666e1d2d-b255-4e75-93b6-73a58225c5d3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:22.841732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-666e1d2d-b255-4e75-93b6-73a58225c5d3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:22.842539 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-666e1d2d-b255-4e75-93b6-73a58225c5d3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:22.843018 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-666e1d2d-b255-4e75-93b6-73a58225c5d3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:22.933383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-666e1d2d-b255-4e75-93b6-73a58225c5d3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 38174 microversion: 2.1 time: 0.104697 Jan 28 01:06:22.934036 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 472/978] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:22 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 38174 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:23.946625 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8f97a822-4b77-4253-968e-4323abed58bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:23.947631 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8f97a822-4b77-4253-968e-4323abed58bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:23.954858 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8f97a822-4b77-4253-968e-4323abed58bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:23.955343 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8f97a822-4b77-4253-968e-4323abed58bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:23.956117 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8f97a822-4b77-4253-968e-4323abed58bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:23.956554 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8f97a822-4b77-4253-968e-4323abed58bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:24.059393 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8f97a822-4b77-4253-968e-4323abed58bc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 200 len: 38303 microversion: 2.1 time: 0.117295 Jan 28 01:06:24.060053 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 507/979] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:23 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 38303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:06:24.070459 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-91524934-1c11-46d0-8417-34da2d938cf1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:24.071076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-91524934-1c11-46d0-8417-34da2d938cf1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:24.078124 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-91524934-1c11-46d0-8417-34da2d938cf1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:24.078577 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-91524934-1c11-46d0-8417-34da2d938cf1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:24.079428 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-91524934-1c11-46d0-8417-34da2d938cf1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:24.079867 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-91524934-1c11-46d0-8417-34da2d938cf1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:24.103711 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-91524934-1c11-46d0-8417-34da2d938cf1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/ips" status: 200 len: 146 microversion: 2.1 time: 0.037324 Jan 28 01:06:24.104276 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 473/980] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jan 28 01:06:24 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:06:26.338408 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-93623da9-0644-4343-89a1-719829cda2fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ed5371c-4992-4668-9151-14b9ea28e093"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:26.339588 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-93623da9-0644-4343-89a1-719829cda2fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:26.346537 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-93623da9-0644-4343-89a1-719829cda2fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:26.347014 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-93623da9-0644-4343-89a1-719829cda2fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:26.347811 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-93623da9-0644-4343-89a1-719829cda2fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:26.348257 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-93623da9-0644-4343-89a1-719829cda2fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:26.618103 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-93623da9-0644-4343-89a1-719829cda2fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284386 Jan 28 01:06:26.618746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 508/981] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:06:26 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:06:34.085470 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7c1d5a38-536c-4dbb-953e-38613235ec64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:34.091840 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c1d5a38-536c-4dbb-953e-38613235ec64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:34.092299 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c1d5a38-536c-4dbb-953e-38613235ec64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:34.153069 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7c1d5a38-536c-4dbb-953e-38613235ec64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Going to try to stop instance {{(pid=116253) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 01:06:34.194803 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7c1d5a38-536c-4dbb-953e-38613235ec64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 202 len: 0 microversion: 2.1 time: 0.112895 Jan 28 01:06:34.195510 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 474/982] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:34 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:06:34.204689 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6e144d08-9bfc-46fa-8151-2c6c24221b68 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:34.205401 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6e144d08-9bfc-46fa-8151-2c6c24221b68 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:34.213455 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e144d08-9bfc-46fa-8151-2c6c24221b68 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:34.213917 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e144d08-9bfc-46fa-8151-2c6c24221b68 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:34.215105 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e144d08-9bfc-46fa-8151-2c6c24221b68 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:34.215291 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e144d08-9bfc-46fa-8151-2c6c24221b68 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:34.344826 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-6e144d08-9bfc-46fa-8151-2c6c24221b68 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:34.353386 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6e144d08-9bfc-46fa-8151-2c6c24221b68 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.153346 Jan 28 01:06:34.353956 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 509/983] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:34 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:35.371331 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5320a9c5-728e-445c-9341-94707222c351 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:35.372027 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5320a9c5-728e-445c-9341-94707222c351 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:35.378142 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5320a9c5-728e-445c-9341-94707222c351 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:35.378602 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5320a9c5-728e-445c-9341-94707222c351 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:35.379427 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5320a9c5-728e-445c-9341-94707222c351 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:35.380396 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5320a9c5-728e-445c-9341-94707222c351 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:35.509484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5320a9c5-728e-445c-9341-94707222c351 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:35.517420 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5320a9c5-728e-445c-9341-94707222c351 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.150593 Jan 28 01:06:35.517993 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 475/984] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:35 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:36.535280 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-acc1603b-d22c-4051-911c-010130a9aa38 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:36.536078 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-acc1603b-d22c-4051-911c-010130a9aa38 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:36.542420 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acc1603b-d22c-4051-911c-010130a9aa38 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:36.542875 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acc1603b-d22c-4051-911c-010130a9aa38 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:36.543690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acc1603b-d22c-4051-911c-010130a9aa38 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:36.544132 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-acc1603b-d22c-4051-911c-010130a9aa38 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:36.668370 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-acc1603b-d22c-4051-911c-010130a9aa38 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:36.676453 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-acc1603b-d22c-4051-911c-010130a9aa38 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.144855 Jan 28 01:06:36.677538 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 510/985] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:36 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:37.693876 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-aaf39494-57f3-46b8-a02b-4617e823eaa5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:37.694407 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-aaf39494-57f3-46b8-a02b-4617e823eaa5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:37.701000 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-aaf39494-57f3-46b8-a02b-4617e823eaa5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:37.701496 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-aaf39494-57f3-46b8-a02b-4617e823eaa5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:37.702293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-aaf39494-57f3-46b8-a02b-4617e823eaa5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:37.702740 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-aaf39494-57f3-46b8-a02b-4617e823eaa5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:37.834281 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-aaf39494-57f3-46b8-a02b-4617e823eaa5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:37.842091 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-aaf39494-57f3-46b8-a02b-4617e823eaa5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.152467 Jan 28 01:06:37.842663 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 476/986] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:37 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:38.859310 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-7d1b7b52-41ba-4a6a-b8ec-102c76a70a0a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:38.860109 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-7d1b7b52-41ba-4a6a-b8ec-102c76a70a0a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:38.866797 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7d1b7b52-41ba-4a6a-b8ec-102c76a70a0a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:38.867269 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7d1b7b52-41ba-4a6a-b8ec-102c76a70a0a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:38.868046 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7d1b7b52-41ba-4a6a-b8ec-102c76a70a0a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:38.868475 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-7d1b7b52-41ba-4a6a-b8ec-102c76a70a0a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:39.000762 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-7d1b7b52-41ba-4a6a-b8ec-102c76a70a0a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:39.009214 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-7d1b7b52-41ba-4a6a-b8ec-102c76a70a0a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.153544 Jan 28 01:06:39.009785 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 511/987] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:38 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:40.026485 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-79fa4da3-d9a2-4c27-9f01-f791173f9465 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:40.027129 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-79fa4da3-d9a2-4c27-9f01-f791173f9465 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:40.033740 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-79fa4da3-d9a2-4c27-9f01-f791173f9465 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:40.034189 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-79fa4da3-d9a2-4c27-9f01-f791173f9465 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:40.035007 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-79fa4da3-d9a2-4c27-9f01-f791173f9465 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:40.035449 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-79fa4da3-d9a2-4c27-9f01-f791173f9465 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:40.160719 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-79fa4da3-d9a2-4c27-9f01-f791173f9465 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:40.168604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-79fa4da3-d9a2-4c27-9f01-f791173f9465 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.145732 Jan 28 01:06:40.169175 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 477/988] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:40 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:41.185845 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-28917721-af57-4902-b3ce-e842098b286f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:41.186462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-28917721-af57-4902-b3ce-e842098b286f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:41.192813 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-28917721-af57-4902-b3ce-e842098b286f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:41.193269 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-28917721-af57-4902-b3ce-e842098b286f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:41.194055 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-28917721-af57-4902-b3ce-e842098b286f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:41.194498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-28917721-af57-4902-b3ce-e842098b286f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:41.322608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-28917721-af57-4902-b3ce-e842098b286f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:41.330366 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-28917721-af57-4902-b3ce-e842098b286f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.148340 Jan 28 01:06:41.330972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 512/989] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:41 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:42.347948 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cfa53957-cabd-49bf-a515-3d9f78ee025c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:42.349079 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cfa53957-cabd-49bf-a515-3d9f78ee025c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:42.355348 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cfa53957-cabd-49bf-a515-3d9f78ee025c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:42.355800 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cfa53957-cabd-49bf-a515-3d9f78ee025c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:42.356582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cfa53957-cabd-49bf-a515-3d9f78ee025c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:42.357042 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cfa53957-cabd-49bf-a515-3d9f78ee025c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:42.484580 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-cfa53957-cabd-49bf-a515-3d9f78ee025c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:42.492697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cfa53957-cabd-49bf-a515-3d9f78ee025c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.148402 Jan 28 01:06:42.493266 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 478/990] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:42 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:43.509896 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9f48d92c-d03c-4c71-92ab-e9a021bd8d53 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:43.510519 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9f48d92c-d03c-4c71-92ab-e9a021bd8d53 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:43.516950 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9f48d92c-d03c-4c71-92ab-e9a021bd8d53 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:43.517403 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9f48d92c-d03c-4c71-92ab-e9a021bd8d53 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:43.518185 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9f48d92c-d03c-4c71-92ab-e9a021bd8d53 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:43.518654 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9f48d92c-d03c-4c71-92ab-e9a021bd8d53 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:43.647433 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9f48d92c-d03c-4c71-92ab-e9a021bd8d53 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:43.655357 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9f48d92c-d03c-4c71-92ab-e9a021bd8d53 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.149134 Jan 28 01:06:43.655915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 513/991] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:43 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:44.672678 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8609e2df-6f69-41ef-ad33-3e5c8a3839a3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:44.673283 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8609e2df-6f69-41ef-ad33-3e5c8a3839a3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:44.680066 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8609e2df-6f69-41ef-ad33-3e5c8a3839a3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:44.680528 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8609e2df-6f69-41ef-ad33-3e5c8a3839a3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:44.681301 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8609e2df-6f69-41ef-ad33-3e5c8a3839a3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:44.681740 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8609e2df-6f69-41ef-ad33-3e5c8a3839a3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:44.813095 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8609e2df-6f69-41ef-ad33-3e5c8a3839a3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:44.821533 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8609e2df-6f69-41ef-ad33-3e5c8a3839a3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.152467 Jan 28 01:06:44.822102 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 479/992] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:44 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:45.838292 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3aefd87b-6ad5-4c76-9126-3101d0d5460f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:45.839046 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3aefd87b-6ad5-4c76-9126-3101d0d5460f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:45.845168 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3aefd87b-6ad5-4c76-9126-3101d0d5460f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:45.845613 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3aefd87b-6ad5-4c76-9126-3101d0d5460f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:45.846388 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3aefd87b-6ad5-4c76-9126-3101d0d5460f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:45.846819 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3aefd87b-6ad5-4c76-9126-3101d0d5460f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:45.976474 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3aefd87b-6ad5-4c76-9126-3101d0d5460f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:45.984406 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3aefd87b-6ad5-4c76-9126-3101d0d5460f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.149823 Jan 28 01:06:45.984979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 514/993] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:45 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:47.001641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-377883ec-39fc-4f1d-89db-0696ee68b1b0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:47.002270 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-377883ec-39fc-4f1d-89db-0696ee68b1b0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:47.008738 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-377883ec-39fc-4f1d-89db-0696ee68b1b0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:47.009226 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-377883ec-39fc-4f1d-89db-0696ee68b1b0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:47.010020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-377883ec-39fc-4f1d-89db-0696ee68b1b0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:47.010465 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-377883ec-39fc-4f1d-89db-0696ee68b1b0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:47.137256 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-377883ec-39fc-4f1d-89db-0696ee68b1b0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:47.145076 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-377883ec-39fc-4f1d-89db-0696ee68b1b0 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.147020 Jan 28 01:06:47.146121 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 480/994] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:46 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:48.163112 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8dd9f22e-64d6-45b3-95ba-e76170fd3380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:48.163966 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8dd9f22e-64d6-45b3-95ba-e76170fd3380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:48.170258 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8dd9f22e-64d6-45b3-95ba-e76170fd3380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:48.170716 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8dd9f22e-64d6-45b3-95ba-e76170fd3380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:48.171530 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8dd9f22e-64d6-45b3-95ba-e76170fd3380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:48.171972 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8dd9f22e-64d6-45b3-95ba-e76170fd3380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:48.301049 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-8dd9f22e-64d6-45b3-95ba-e76170fd3380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:48.309324 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8dd9f22e-64d6-45b3-95ba-e76170fd3380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.150518 Jan 28 01:06:48.309889 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 515/995] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:48 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:06:49.328564 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7831a5de-7f9b-4f4d-aa38-1ef6db108f4a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:49.329188 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7831a5de-7f9b-4f4d-aa38-1ef6db108f4a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:49.335599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7831a5de-7f9b-4f4d-aa38-1ef6db108f4a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:49.336053 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7831a5de-7f9b-4f4d-aa38-1ef6db108f4a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:49.336837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7831a5de-7f9b-4f4d-aa38-1ef6db108f4a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:49.337283 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7831a5de-7f9b-4f4d-aa38-1ef6db108f4a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:49.467853 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-7831a5de-7f9b-4f4d-aa38-1ef6db108f4a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:49.475618 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7831a5de-7f9b-4f4d-aa38-1ef6db108f4a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1724 microversion: 2.1 time: 0.153200 Jan 28 01:06:49.476190 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 481/996] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:49 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:50.493285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3f8ae853-f76e-4f7e-b763-ca50486188aa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:50.493925 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3f8ae853-f76e-4f7e-b763-ca50486188aa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:50.500408 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3f8ae853-f76e-4f7e-b763-ca50486188aa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:50.500850 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3f8ae853-f76e-4f7e-b763-ca50486188aa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:50.501616 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3f8ae853-f76e-4f7e-b763-ca50486188aa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:50.502050 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3f8ae853-f76e-4f7e-b763-ca50486188aa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:50.628378 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3f8ae853-f76e-4f7e-b763-ca50486188aa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:50.636594 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3f8ae853-f76e-4f7e-b763-ca50486188aa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1701 microversion: 2.1 time: 0.146938 Jan 28 01:06:50.637367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 516/997] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:50 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1701 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:50.654092 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-186c16e2-3bb9-4403-bff9-8de1de0d5579 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:50.660752 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-186c16e2-3bb9-4403-bff9-8de1de0d5579 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:50.661209 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-186c16e2-3bb9-4403-bff9-8de1de0d5579 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:50.683185 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-186c16e2-3bb9-4403-bff9-8de1de0d5579 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Going to try to start instance {{(pid=116253) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 01:06:50.726709 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-186c16e2-3bb9-4403-bff9-8de1de0d5579 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 202 len: 0 microversion: 2.1 time: 0.076761 Jan 28 01:06:50.727495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 482/998] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:06:50 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:06:50.735603 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e936a11d-04e1-4eab-b709-d665b45d8aed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:50.736355 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e936a11d-04e1-4eab-b709-d665b45d8aed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:50.743889 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e936a11d-04e1-4eab-b709-d665b45d8aed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:50.744374 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e936a11d-04e1-4eab-b709-d665b45d8aed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:50.745210 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e936a11d-04e1-4eab-b709-d665b45d8aed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:50.745595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e936a11d-04e1-4eab-b709-d665b45d8aed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:50.872339 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e936a11d-04e1-4eab-b709-d665b45d8aed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:50.884612 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e936a11d-04e1-4eab-b709-d665b45d8aed tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1710 microversion: 2.1 time: 0.152236 Jan 28 01:06:50.885672 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 517/999] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:50 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:51.907555 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-bdca00ca-c3a3-487e-8472-80003852bfef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:51.908267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-bdca00ca-c3a3-487e-8472-80003852bfef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:51.914464 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bdca00ca-c3a3-487e-8472-80003852bfef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:51.914945 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bdca00ca-c3a3-487e-8472-80003852bfef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:51.915741 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bdca00ca-c3a3-487e-8472-80003852bfef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:51.916185 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-bdca00ca-c3a3-487e-8472-80003852bfef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:52.049340 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-bdca00ca-c3a3-487e-8472-80003852bfef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:52.057336 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-bdca00ca-c3a3-487e-8472-80003852bfef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1710 microversion: 2.1 time: 0.154484 Jan 28 01:06:52.057934 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 483/1000] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:51 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:53.075381 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2d7be34d-ef93-4432-8029-127c7753824f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:06:53.075995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2d7be34d-ef93-4432-8029-127c7753824f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:06:53.082356 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d7be34d-ef93-4432-8029-127c7753824f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:53.082810 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d7be34d-ef93-4432-8029-127c7753824f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:53.083625 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d7be34d-ef93-4432-8029-127c7753824f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:53.084070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2d7be34d-ef93-4432-8029-127c7753824f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:53.212825 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2d7be34d-ef93-4432-8029-127c7753824f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:06:53.220796 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2d7be34d-ef93-4432-8029-127c7753824f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1714 microversion: 2.1 time: 0.149184 Jan 28 01:06:53.221361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 518/1001] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:06:53 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:08.259804 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c3bc6913-2779-4709-87f4-21ecd8cdbd17 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:08.260344 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c3bc6913-2779-4709-87f4-21ecd8cdbd17 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:08.260991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-a193cfb2-6ef2-442a-9342-547e03cf0373 req-56faf387-8820-482d-aff0-14d729c4a3da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e78861-36ac-4839-a201-ad85a067439a", "tag": "2bcf2856-230f-406e-be0e-7ecdcc4a3436"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:08.263230 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:07:08.263230 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:07:08.268209 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c3bc6913-2779-4709-87f4-21ecd8cdbd17 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:08.269007 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c3bc6913-2779-4709-87f4-21ecd8cdbd17 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:08.270199 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c3bc6913-2779-4709-87f4-21ecd8cdbd17 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:08.270759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c3bc6913-2779-4709-87f4-21ecd8cdbd17 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:08.272677 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-a193cfb2-6ef2-442a-9342-547e03cf0373 req-56faf387-8820-482d-aff0-14d729c4a3da service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:08.273178 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-a193cfb2-6ef2-442a-9342-547e03cf0373 req-56faf387-8820-482d-aff0-14d729c4a3da service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:08.286560 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-a193cfb2-6ef2-442a-9342-547e03cf0373 req-56faf387-8820-482d-aff0-14d729c4a3da service nova] Creating event network-changed:2bcf2856-230f-406e-be0e-7ecdcc4a3436 for instance 47e78861-36ac-4839-a201-ad85a067439a on hv-cinder-81689 Jan 28 01:07:08.291854 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-a193cfb2-6ef2-442a-9342-547e03cf0373 req-56faf387-8820-482d-aff0-14d729c4a3da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035185 Jan 28 01:07:08.292968 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 519/1002] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:07:08.301167 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c3bc6913-2779-4709-87f4-21ecd8cdbd17 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:07:08.383153 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c3bc6913-2779-4709-87f4-21ecd8cdbd17 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "DELETE /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 204 len: 0 microversion: 2.1 time: 0.129468 Jan 28 01:07:08.384175 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 484/1003] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:07:08 2022] DELETE /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:07:08.392803 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-eaedeefe-b555-4134-8ede-f741e9ecb4ff tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:08.393839 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-eaedeefe-b555-4134-8ede-f741e9ecb4ff tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:08.400256 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eaedeefe-b555-4134-8ede-f741e9ecb4ff tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:08.400802 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eaedeefe-b555-4134-8ede-f741e9ecb4ff tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:08.401675 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eaedeefe-b555-4134-8ede-f741e9ecb4ff tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:08.402354 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eaedeefe-b555-4134-8ede-f741e9ecb4ff tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:08.538674 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-eaedeefe-b555-4134-8ede-f741e9ecb4ff tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:08.546622 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-eaedeefe-b555-4134-8ede-f741e9ecb4ff tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1569 microversion: 2.1 time: 0.157967 Jan 28 01:07:08.547253 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 520/1004] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:08 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:09.564366 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-28dd2124-682f-4238-8479-dcc3147df39e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:09.565007 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-28dd2124-682f-4238-8479-dcc3147df39e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:09.571919 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28dd2124-682f-4238-8479-dcc3147df39e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:09.572378 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28dd2124-682f-4238-8479-dcc3147df39e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:09.573169 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28dd2124-682f-4238-8479-dcc3147df39e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:09.573614 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-28dd2124-682f-4238-8479-dcc3147df39e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:09.703062 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-28dd2124-682f-4238-8479-dcc3147df39e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:09.711178 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-28dd2124-682f-4238-8479-dcc3147df39e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1451 microversion: 2.1 time: 0.150808 Jan 28 01:07:09.712141 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 485/1005] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:09 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:10.729177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d2bcdf29-9afd-46e9-ae1c-80c0868bba71 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:10.729791 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d2bcdf29-9afd-46e9-ae1c-80c0868bba71 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:10.736090 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d2bcdf29-9afd-46e9-ae1c-80c0868bba71 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:10.736546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d2bcdf29-9afd-46e9-ae1c-80c0868bba71 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:10.737332 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d2bcdf29-9afd-46e9-ae1c-80c0868bba71 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:10.737777 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d2bcdf29-9afd-46e9-ae1c-80c0868bba71 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:10.807329 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d2bcdf29-9afd-46e9-ae1c-80c0868bba71 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:10.815386 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d2bcdf29-9afd-46e9-ae1c-80c0868bba71 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1383 microversion: 2.1 time: 0.089870 Jan 28 01:07:10.816164 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 521/1006] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:10 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1383 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:10.859732 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-ca7f0845-12b6-4dd1-b159-509419d8c6b9 req-fb9b42cc-f706-4955-a37a-0134d96eabc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e78861-36ac-4839-a201-ad85a067439a", "name": "network-vif-deleted", "tag": "2bcf2856-230f-406e-be0e-7ecdcc4a3436"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:10.861428 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:07:10.861428 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:07:10.872595 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-ca7f0845-12b6-4dd1-b159-509419d8c6b9 req-fb9b42cc-f706-4955-a37a-0134d96eabc0 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:10.873037 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-ca7f0845-12b6-4dd1-b159-509419d8c6b9 req-fb9b42cc-f706-4955-a37a-0134d96eabc0 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:10.888990 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-ca7f0845-12b6-4dd1-b159-509419d8c6b9 req-fb9b42cc-f706-4955-a37a-0134d96eabc0 service nova] Creating event network-vif-deleted:2bcf2856-230f-406e-be0e-7ecdcc4a3436 for instance 47e78861-36ac-4839-a201-ad85a067439a on hv-cinder-81689 Jan 28 01:07:10.893600 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-ca7f0845-12b6-4dd1-b159-509419d8c6b9 req-fb9b42cc-f706-4955-a37a-0134d96eabc0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041492 Jan 28 01:07:10.894190 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 486/1007] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:07:11.832083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:11.833344 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:11.841017 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:11.841471 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:11.842266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:11.842826 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:11.873473 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:11.873872 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:11.874333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lazy-loading 'fault' on Instance uuid 47e78861-36ac-4839-a201-ad85a067439a {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:07:11.913582 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d352592e91a48e38a6ecbb7293fd298', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e156503ec1b459fbe5516b459e0c38b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:11.920208 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-374e195c-23ae-4f0b-b161-429537d1917e tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 200 len: 1178 microversion: 2.1 time: 0.091836 Jan 28 01:07:11.920773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 522/1008] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:11 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 1178 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:12.937969 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9c727677-e5b2-4e62-bf66-5513f3fa5084 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:12.938678 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-9c727677-e5b2-4e62-bf66-5513f3fa5084 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] [instance: 47e78861-36ac-4839-a201-ad85a067439a] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:12.945294 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c727677-e5b2-4e62-bf66-5513f3fa5084 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:12.945749 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c727677-e5b2-4e62-bf66-5513f3fa5084 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:12.946539 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c727677-e5b2-4e62-bf66-5513f3fa5084 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:12.947005 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-9c727677-e5b2-4e62-bf66-5513f3fa5084 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:12.960431 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-9c727677-e5b2-4e62-bf66-5513f3fa5084 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] HTTP exception thrown: Instance 47e78861-36ac-4839-a201-ad85a067439a could not be found. Jan 28 01:07:12.961023 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-9c727677-e5b2-4e62-bf66-5513f3fa5084 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Returning 404 to user: Instance 47e78861-36ac-4839-a201-ad85a067439a could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:07:12.961875 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-9c727677-e5b2-4e62-bf66-5513f3fa5084 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a" status: 404 len: 111 microversion: 2.1 time: 0.028449 Jan 28 01:07:12.962409 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 487/1009] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:12 2022] GET /compute/v2.1/servers/47e78861-36ac-4839-a201-ad85a067439a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:07:13.115628 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d06d1930-c120-4515-902e-90f8de6a3bd8 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] Calling method '.version_select at 0x7f1a0925f0d0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:13.139609 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d06d1930-c120-4515-902e-90f8de6a3bd8 tempest-TestShelveInstance-883938074 tempest-TestShelveInstance-883938074-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-877278054" status: 202 len: 0 microversion: 2.1 time: 0.027879 Jan 28 01:07:13.140153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 523/1010] 10.222.0.78 () {58 vars in 1250 bytes} [Fri Jan 28 01:07:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-877278054 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:07:15.757180 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b586296b-8e89-4f02-a29a-24582683a7bd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:15.758290 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b586296b-8e89-4f02-a29a-24582683a7bd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:15.764335 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b586296b-8e89-4f02-a29a-24582683a7bd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:15.764986 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b586296b-8e89-4f02-a29a-24582683a7bd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:15.765954 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b586296b-8e89-4f02-a29a-24582683a7bd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:15.766557 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b586296b-8e89-4f02-a29a-24582683a7bd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:15.792796 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b586296b-8e89-4f02-a29a-24582683a7bd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:07:15.879505 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b586296b-8e89-4f02-a29a-24582683a7bd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "DELETE /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 204 len: 0 microversion: 2.1 time: 0.126307 Jan 28 01:07:15.880477 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 488/1011] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:07:15 2022] DELETE /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:07:15.890079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1f275097-fcaa-4283-a48b-f7efe399de04 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:15.891314 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1f275097-fcaa-4283-a48b-f7efe399de04 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:15.899115 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f275097-fcaa-4283-a48b-f7efe399de04 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:15.899698 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f275097-fcaa-4283-a48b-f7efe399de04 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:15.900512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f275097-fcaa-4283-a48b-f7efe399de04 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:15.900950 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f275097-fcaa-4283-a48b-f7efe399de04 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:16.037081 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-1f275097-fcaa-4283-a48b-f7efe399de04 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:16.045513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1f275097-fcaa-4283-a48b-f7efe399de04 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1580 microversion: 2.1 time: 0.159993 Jan 28 01:07:16.046228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 524/1012] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:15 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1580 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:17.063718 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a32214c4-b4aa-4d9c-ae91-af7200d48c6c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:17.064444 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a32214c4-b4aa-4d9c-ae91-af7200d48c6c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:17.071873 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a32214c4-b4aa-4d9c-ae91-af7200d48c6c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:17.072334 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a32214c4-b4aa-4d9c-ae91-af7200d48c6c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:17.073149 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a32214c4-b4aa-4d9c-ae91-af7200d48c6c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:17.073599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a32214c4-b4aa-4d9c-ae91-af7200d48c6c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:17.226783 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a32214c4-b4aa-4d9c-ae91-af7200d48c6c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:17.235698 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a32214c4-b4aa-4d9c-ae91-af7200d48c6c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1580 microversion: 2.1 time: 0.176096 Jan 28 01:07:17.236296 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 489/1013] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:17 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1580 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:18.258072 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-eef4e664-e264-45e0-9a0b-b58674286c91 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:18.259612 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-eef4e664-e264-45e0-9a0b-b58674286c91 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:18.269614 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eef4e664-e264-45e0-9a0b-b58674286c91 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:18.270857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eef4e664-e264-45e0-9a0b-b58674286c91 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:18.271912 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eef4e664-e264-45e0-9a0b-b58674286c91 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:18.272709 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eef4e664-e264-45e0-9a0b-b58674286c91 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:18.649683 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-eef4e664-e264-45e0-9a0b-b58674286c91 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:18.660064 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-eef4e664-e264-45e0-9a0b-b58674286c91 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1580 microversion: 2.1 time: 0.408084 Jan 28 01:07:18.674981 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 525/1014] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:18 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1580 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:18.911657 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-c59c73bb-4be1-4f96-b51d-edb2fb62f647 req-e33a32e4-ea8c-4be4-b842-83173242475a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd", "name": "network-vif-deleted", "tag": "0358ec0e-3460-4353-ba22-1ecfe9abe10c"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:18.913988 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:07:18.913988 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:07:18.922342 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-c59c73bb-4be1-4f96-b51d-edb2fb62f647 req-e33a32e4-ea8c-4be4-b842-83173242475a service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:18.922932 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-c59c73bb-4be1-4f96-b51d-edb2fb62f647 req-e33a32e4-ea8c-4be4-b842-83173242475a service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:18.955446 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-c59c73bb-4be1-4f96-b51d-edb2fb62f647 req-e33a32e4-ea8c-4be4-b842-83173242475a service nova] Creating event network-vif-deleted:0358ec0e-3460-4353-ba22-1ecfe9abe10c for instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd on hv-cinder-81689 Jan 28 01:07:18.967292 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-c59c73bb-4be1-4f96-b51d-edb2fb62f647 req-e33a32e4-ea8c-4be4-b842-83173242475a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060999 Jan 28 01:07:18.970017 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 490/1015] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:07:19.689510 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:19.692706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:19.704505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:19.704806 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:19.705870 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:19.707423 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:19.753581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:19.755045 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:19.755675 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lazy-loading 'fault' on Instance uuid 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:07:19.803344 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:19.820883 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-77c5cebf-7422-4a84-8991-a995ef341be4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 200 len: 1231 microversion: 2.1 time: 0.144668 Jan 28 01:07:19.823499 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 526/1016] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:19 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 1231 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:20.841798 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2dd771f2-9a3f-4e32-ab52-2a507abf53f1 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:20.842509 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2dd771f2-9a3f-4e32-ab52-2a507abf53f1 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:20.848524 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2dd771f2-9a3f-4e32-ab52-2a507abf53f1 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:20.848982 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2dd771f2-9a3f-4e32-ab52-2a507abf53f1 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:20.849768 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2dd771f2-9a3f-4e32-ab52-2a507abf53f1 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:20.850219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2dd771f2-9a3f-4e32-ab52-2a507abf53f1 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:20.864490 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-2dd771f2-9a3f-4e32-ab52-2a507abf53f1 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] HTTP exception thrown: Instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd could not be found. Jan 28 01:07:20.865098 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2dd771f2-9a3f-4e32-ab52-2a507abf53f1 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Returning 404 to user: Instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:07:20.865935 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2dd771f2-9a3f-4e32-ab52-2a507abf53f1 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 404 len: 111 microversion: 2.1 time: 0.029294 Jan 28 01:07:20.866478 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 491/1017] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:20 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:07:20.960024 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-801030593", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1017196631", "security_groups": [{"name": "tempest-secgroup-smoke-1597946477"}], "block_device_mapping_v2": [{"uuid": "f197dcee-dc4e-40ba-8206-6c3cdf2b9640", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bb0bc5c-1a8f-440b-a693-6e8a7b68363c"}]}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:21.073289 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.network.neutron [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] validate_networks() for [('3bb0bc5c-1a8f-440b-a693-6e8a7b68363c', None, None, None, None, None)] {{(pid=116254) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:07:21.464692 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Flavor limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:07:21.465122 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Image limits 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:07:21.465599 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Flavor pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:07:21.466012 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Image pref 0:0:0 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:07:21.466453 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.virt.hardware [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:07:21.476868 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:21.477326 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:21.478135 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:21.478572 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:21.496030 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:07:21.499317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for user 38bed71713534d0999a15ea8440717a5 and project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'cores', 'instances', 'ram'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:07:21.553958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Going to run 1 instances... {{(pid=116254) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:07:21.556151 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f197dcee-dc4e-40ba-8206-6c3cdf2b9640',volume_size=None,volume_type=None)] {{(pid=116254) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:07:21.673995 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6ea8632f-f0a7-4e1d-8ef8-8051724a80c5 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.718078 Jan 28 01:07:21.674557 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 527/1018] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:07:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:07:21.684933 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2a5c7b0e-52a7-4f0d-89b5-018af361108c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:21.685643 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2a5c7b0e-52a7-4f0d-89b5-018af361108c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:21.739345 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-2a5c7b0e-52a7-4f0d-89b5-018af361108c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:21.746219 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2a5c7b0e-52a7-4f0d-89b5-018af361108c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1094 microversion: 2.1 time: 0.065031 Jan 28 01:07:21.746820 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 492/1019] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:21 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:22.763670 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4e592292-50e9-4597-a126-9d41b9cc549e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:22.764282 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4e592292-50e9-4597-a126-9d41b9cc549e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:22.771282 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4e592292-50e9-4597-a126-9d41b9cc549e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:22.771733 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4e592292-50e9-4597-a126-9d41b9cc549e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:22.772512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4e592292-50e9-4597-a126-9d41b9cc549e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:22.772951 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4e592292-50e9-4597-a126-9d41b9cc549e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:22.836083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4e592292-50e9-4597-a126-9d41b9cc549e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:22.843906 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4e592292-50e9-4597-a126-9d41b9cc549e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1210 microversion: 2.1 time: 0.084161 Jan 28 01:07:22.844813 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 528/1020] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:22 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:23.860812 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4f3e7287-4078-4acb-895d-6722dd88bb63 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:23.861439 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4f3e7287-4078-4acb-895d-6722dd88bb63 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:23.870502 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f3e7287-4078-4acb-895d-6722dd88bb63 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:23.871332 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f3e7287-4078-4acb-895d-6722dd88bb63 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:23.872327 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f3e7287-4078-4acb-895d-6722dd88bb63 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:23.872941 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4f3e7287-4078-4acb-895d-6722dd88bb63 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:24.114608 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4f3e7287-4078-4acb-895d-6722dd88bb63 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:24.119388 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-aafecb94-cfff-4c9a-bcee-e8c4e60bf257 req-27a9d82b-c593-4ac7-bf70-4786ea708a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3531392-d8a5-4709-a9d7-fda2d5d83dba", "tag": "79623ca0-bf5f-4222-a661-53089e18c3c2"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:24.121109 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:07:24.121109 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:07:24.129582 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4f3e7287-4078-4acb-895d-6722dd88bb63 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.272086 Jan 28 01:07:24.133289 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-aafecb94-cfff-4c9a-bcee-e8c4e60bf257 req-27a9d82b-c593-4ac7-bf70-4786ea708a7c service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:24.134357 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-aafecb94-cfff-4c9a-bcee-e8c4e60bf257 req-27a9d82b-c593-4ac7-bf70-4786ea708a7c service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:24.139595 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 493/1021] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:23 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:24.154387 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-aafecb94-cfff-4c9a-bcee-e8c4e60bf257 req-27a9d82b-c593-4ac7-bf70-4786ea708a7c service nova] Creating event network-changed:79623ca0-bf5f-4222-a661-53089e18c3c2 for instance b3531392-d8a5-4709-a9d7-fda2d5d83dba on hv-cinder-81689 Jan 28 01:07:24.159920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-aafecb94-cfff-4c9a-bcee-e8c4e60bf257 req-27a9d82b-c593-4ac7-bf70-4786ea708a7c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050801 Jan 28 01:07:24.161038 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 529/1022] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:07:25.147327 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c59f7916-f545-4841-9939-4b719521f462 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:25.147990 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c59f7916-f545-4841-9939-4b719521f462 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:25.154188 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c59f7916-f545-4841-9939-4b719521f462 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:25.154636 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c59f7916-f545-4841-9939-4b719521f462 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:25.155696 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c59f7916-f545-4841-9939-4b719521f462 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:25.156130 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c59f7916-f545-4841-9939-4b719521f462 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:25.288711 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c59f7916-f545-4841-9939-4b719521f462 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:25.296059 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c59f7916-f545-4841-9939-4b719521f462 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.152960 Jan 28 01:07:25.296621 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 494/1023] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:25 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:26.115028 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-95610c60-36c5-4e6c-9ba7-95b83f3b3aa6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:26.115684 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-95610c60-36c5-4e6c-9ba7-95b83f3b3aa6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:26.121897 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-95610c60-36c5-4e6c-9ba7-95b83f3b3aa6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:26.122343 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-95610c60-36c5-4e6c-9ba7-95b83f3b3aa6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:26.123140 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-95610c60-36c5-4e6c-9ba7-95b83f3b3aa6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:26.123573 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-95610c60-36c5-4e6c-9ba7-95b83f3b3aa6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:26.201346 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-95610c60-36c5-4e6c-9ba7-95b83f3b3aa6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lazy-loading 'services' on Instance uuid 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:07:26.270751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-95610c60-36c5-4e6c-9ba7-95b83f3b3aa6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/os-volume_attachments/1ed5371c-4992-4668-9151-14b9ea28e093" status: 202 len: 0 microversion: 2.1 time: 0.160703 Jan 28 01:07:26.271578 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 530/1024] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:07:26 2022] DELETE /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/os-volume_attachments/1ed5371c-4992-4668-9151-14b9ea28e093 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:07:26.313428 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-64193edc-6d60-4a17-9b79-ed946cde5cda tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:26.314825 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-64193edc-6d60-4a17-9b79-ed946cde5cda tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:26.322102 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-64193edc-6d60-4a17-9b79-ed946cde5cda tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:26.322641 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-64193edc-6d60-4a17-9b79-ed946cde5cda tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:26.323667 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-64193edc-6d60-4a17-9b79-ed946cde5cda tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:26.324183 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-64193edc-6d60-4a17-9b79-ed946cde5cda tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:26.456221 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-64193edc-6d60-4a17-9b79-ed946cde5cda tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:26.463848 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-64193edc-6d60-4a17-9b79-ed946cde5cda tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.154211 Jan 28 01:07:26.464420 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 495/1025] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:26 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:27.380116 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6e6eb028-c385-438f-8ff8-a85e20aa696e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:27.387034 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e6eb028-c385-438f-8ff8-a85e20aa696e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:27.387496 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6e6eb028-c385-438f-8ff8-a85e20aa696e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:27.448036 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6e6eb028-c385-438f-8ff8-a85e20aa696e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Going to try to stop instance {{(pid=116254) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 01:07:27.481755 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4a51e14e-2679-49d8-9013-312c7dc98840 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:27.482371 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4a51e14e-2679-49d8-9013-312c7dc98840 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:27.489293 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a51e14e-2679-49d8-9013-312c7dc98840 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:27.489937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a51e14e-2679-49d8-9013-312c7dc98840 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:27.490747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a51e14e-2679-49d8-9013-312c7dc98840 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:27.491252 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4a51e14e-2679-49d8-9013-312c7dc98840 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:27.491367 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6e6eb028-c385-438f-8ff8-a85e20aa696e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 202 len: 0 microversion: 2.1 time: 0.114949 Jan 28 01:07:27.491842 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 531/1026] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:07:27 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:07:27.500330 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-665e8ef6-867a-4889-bddc-bfc9b2e4d9be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:27.501029 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-665e8ef6-867a-4889-bddc-bfc9b2e4d9be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:27.507228 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-665e8ef6-867a-4889-bddc-bfc9b2e4d9be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:27.507842 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-665e8ef6-867a-4889-bddc-bfc9b2e4d9be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:27.508681 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-665e8ef6-867a-4889-bddc-bfc9b2e4d9be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:27.509093 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-665e8ef6-867a-4889-bddc-bfc9b2e4d9be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:27.630484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4a51e14e-2679-49d8-9013-312c7dc98840 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:27.637874 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4a51e14e-2679-49d8-9013-312c7dc98840 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.159953 Jan 28 01:07:27.638447 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 496/1027] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:27 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:07:27.648674 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-665e8ef6-867a-4889-bddc-bfc9b2e4d9be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:27.656271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-665e8ef6-867a-4889-bddc-bfc9b2e4d9be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1678 microversion: 2.1 time: 0.159781 Jan 28 01:07:27.656837 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 532/1028] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:27 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:28.654150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1327525e-13ee-4c73-9b16-5d8174532f88 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:28.654766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1327525e-13ee-4c73-9b16-5d8174532f88 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:28.661361 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1327525e-13ee-4c73-9b16-5d8174532f88 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:28.661809 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1327525e-13ee-4c73-9b16-5d8174532f88 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:28.662587 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1327525e-13ee-4c73-9b16-5d8174532f88 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:28.663054 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1327525e-13ee-4c73-9b16-5d8174532f88 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:28.673391 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3b696b26-74a3-412b-a921-ae781d8437fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:28.674006 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3b696b26-74a3-412b-a921-ae781d8437fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:28.680327 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b696b26-74a3-412b-a921-ae781d8437fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:28.680778 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b696b26-74a3-412b-a921-ae781d8437fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:28.681562 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b696b26-74a3-412b-a921-ae781d8437fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:28.682000 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3b696b26-74a3-412b-a921-ae781d8437fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:28.794056 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1327525e-13ee-4c73-9b16-5d8174532f88 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:28.801452 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1327525e-13ee-4c73-9b16-5d8174532f88 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.150933 Jan 28 01:07:28.802025 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 497/1029] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:28 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:28.810013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3b696b26-74a3-412b-a921-ae781d8437fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:28.817796 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3b696b26-74a3-412b-a921-ae781d8437fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1678 microversion: 2.1 time: 0.148027 Jan 28 01:07:28.818351 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 533/1030] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:28 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:29.818507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-8e3c4c0f-b3ff-45fd-9bcb-521929aff85e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:29.819152 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-8e3c4c0f-b3ff-45fd-9bcb-521929aff85e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:29.825500 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8e3c4c0f-b3ff-45fd-9bcb-521929aff85e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:29.825967 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8e3c4c0f-b3ff-45fd-9bcb-521929aff85e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:29.826759 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8e3c4c0f-b3ff-45fd-9bcb-521929aff85e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:29.827233 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-8e3c4c0f-b3ff-45fd-9bcb-521929aff85e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:29.834235 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b61825b0-1175-48d3-a778-5fbf5ffe4583 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:29.834848 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b61825b0-1175-48d3-a778-5fbf5ffe4583 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:29.841142 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b61825b0-1175-48d3-a778-5fbf5ffe4583 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:29.841595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b61825b0-1175-48d3-a778-5fbf5ffe4583 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:29.842385 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b61825b0-1175-48d3-a778-5fbf5ffe4583 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:29.842827 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b61825b0-1175-48d3-a778-5fbf5ffe4583 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:29.955191 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-8e3c4c0f-b3ff-45fd-9bcb-521929aff85e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:29.962816 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-8e3c4c0f-b3ff-45fd-9bcb-521929aff85e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.148680 Jan 28 01:07:29.963401 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 498/1031] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:29 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:29.973351 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b61825b0-1175-48d3-a778-5fbf5ffe4583 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:29.980547 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b61825b0-1175-48d3-a778-5fbf5ffe4583 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1678 microversion: 2.1 time: 0.149902 Jan 28 01:07:29.981114 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 534/1032] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:29 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:07:30.979609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0c012802-374d-47e2-be4c-bcd761dc3f69 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:30.980225 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0c012802-374d-47e2-be4c-bcd761dc3f69 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:30.986537 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0c012802-374d-47e2-be4c-bcd761dc3f69 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:30.987024 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0c012802-374d-47e2-be4c-bcd761dc3f69 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:30.987808 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0c012802-374d-47e2-be4c-bcd761dc3f69 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:30.988247 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0c012802-374d-47e2-be4c-bcd761dc3f69 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:30.997558 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-76dc6e1c-4396-42ec-bd56-23721bb788be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:30.998162 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-76dc6e1c-4396-42ec-bd56-23721bb788be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:31.004402 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-76dc6e1c-4396-42ec-bd56-23721bb788be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:31.004847 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-76dc6e1c-4396-42ec-bd56-23721bb788be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:31.005618 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-76dc6e1c-4396-42ec-bd56-23721bb788be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:31.006048 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-76dc6e1c-4396-42ec-bd56-23721bb788be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:31.121080 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0c012802-374d-47e2-be4c-bcd761dc3f69 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:31.128402 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0c012802-374d-47e2-be4c-bcd761dc3f69 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.152437 Jan 28 01:07:31.129473 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 499/1033] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:30 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:31.134444 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-76dc6e1c-4396-42ec-bd56-23721bb788be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:31.141684 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-76dc6e1c-4396-42ec-bd56-23721bb788be tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1678 microversion: 2.1 time: 0.147700 Jan 28 01:07:31.142242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 535/1034] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:30 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:07:32.145542 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-60a82b00-b85c-41c9-b008-753a59f50595 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:32.146111 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-60a82b00-b85c-41c9-b008-753a59f50595 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:32.152614 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-60a82b00-b85c-41c9-b008-753a59f50595 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:32.153077 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-60a82b00-b85c-41c9-b008-753a59f50595 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:32.153872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-60a82b00-b85c-41c9-b008-753a59f50595 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:32.154318 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-60a82b00-b85c-41c9-b008-753a59f50595 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:32.158446 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-428fb453-a0c6-4480-8bf3-2bc8c5c1c17f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:32.159096 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-428fb453-a0c6-4480-8bf3-2bc8c5c1c17f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:32.165299 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-428fb453-a0c6-4480-8bf3-2bc8c5c1c17f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:32.165757 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-428fb453-a0c6-4480-8bf3-2bc8c5c1c17f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:32.166833 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-428fb453-a0c6-4480-8bf3-2bc8c5c1c17f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:32.166986 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-428fb453-a0c6-4480-8bf3-2bc8c5c1c17f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:32.283541 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-60a82b00-b85c-41c9-b008-753a59f50595 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:32.291537 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-60a82b00-b85c-41c9-b008-753a59f50595 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.149588 Jan 28 01:07:32.292054 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 500/1035] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:32 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:32.293930 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-428fb453-a0c6-4480-8bf3-2bc8c5c1c17f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:32.307717 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-428fb453-a0c6-4480-8bf3-2bc8c5c1c17f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1678 microversion: 2.1 time: 0.152984 Jan 28 01:07:32.308317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 536/1036] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:32 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:07:33.307915 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-86393979-bfc3-4c27-a423-dabf1744d423 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:33.308546 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-86393979-bfc3-4c27-a423-dabf1744d423 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:33.314901 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-86393979-bfc3-4c27-a423-dabf1744d423 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:33.315365 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-86393979-bfc3-4c27-a423-dabf1744d423 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:33.316185 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-86393979-bfc3-4c27-a423-dabf1744d423 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:33.316633 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-86393979-bfc3-4c27-a423-dabf1744d423 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:33.323744 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-3dd4130a-b6d1-45eb-a1e5-0edbecd38127 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:33.324361 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-3dd4130a-b6d1-45eb-a1e5-0edbecd38127 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:33.330571 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3dd4130a-b6d1-45eb-a1e5-0edbecd38127 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:33.331058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3dd4130a-b6d1-45eb-a1e5-0edbecd38127 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:33.331845 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3dd4130a-b6d1-45eb-a1e5-0edbecd38127 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:33.332285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-3dd4130a-b6d1-45eb-a1e5-0edbecd38127 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:33.472284 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-3dd4130a-b6d1-45eb-a1e5-0edbecd38127 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:33.478976 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-86393979-bfc3-4c27-a423-dabf1744d423 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:33.480122 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-3dd4130a-b6d1-45eb-a1e5-0edbecd38127 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1678 microversion: 2.1 time: 0.159949 Jan 28 01:07:33.480709 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 537/1037] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:33 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:07:33.487139 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-86393979-bfc3-4c27-a423-dabf1744d423 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.182824 Jan 28 01:07:33.487778 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 501/1038] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:33 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:33.589279 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-cb512c5b-33af-4e05-b9b9-c8abb28cd2e0 req-d7d2b9b2-03fe-4d07-af78-1e07a2e46328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3531392-d8a5-4709-a9d7-fda2d5d83dba", "name": "network-vif-plugged", "status": "completed", "tag": "79623ca0-bf5f-4222-a661-53089e18c3c2"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:33.590966 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:07:33.590966 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:07:33.597938 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-cb512c5b-33af-4e05-b9b9-c8abb28cd2e0 req-d7d2b9b2-03fe-4d07-af78-1e07a2e46328 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:33.598409 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-cb512c5b-33af-4e05-b9b9-c8abb28cd2e0 req-d7d2b9b2-03fe-4d07-af78-1e07a2e46328 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:33.609590 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-cb512c5b-33af-4e05-b9b9-c8abb28cd2e0 req-d7d2b9b2-03fe-4d07-af78-1e07a2e46328 service nova] Creating event network-vif-plugged:79623ca0-bf5f-4222-a661-53089e18c3c2 for instance b3531392-d8a5-4709-a9d7-fda2d5d83dba on hv-cinder-81689 Jan 28 01:07:33.615079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-cb512c5b-33af-4e05-b9b9-c8abb28cd2e0 req-d7d2b9b2-03fe-4d07-af78-1e07a2e46328 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029490 Jan 28 01:07:33.615722 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 538/1039] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:07:34.496627 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0f62f972-c629-4de6-94cb-5ed54f2d4797 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:34.497251 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0f62f972-c629-4de6-94cb-5ed54f2d4797 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:34.503672 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f62f972-c629-4de6-94cb-5ed54f2d4797 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:34.504709 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f62f972-c629-4de6-94cb-5ed54f2d4797 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:34.505505 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a0067720-53cb-4bb6-9040-5087f4f16084 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:34.505921 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f62f972-c629-4de6-94cb-5ed54f2d4797 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:34.506018 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0f62f972-c629-4de6-94cb-5ed54f2d4797 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:34.506197 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a0067720-53cb-4bb6-9040-5087f4f16084 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:34.512145 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a0067720-53cb-4bb6-9040-5087f4f16084 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:34.512588 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a0067720-53cb-4bb6-9040-5087f4f16084 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:34.513362 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a0067720-53cb-4bb6-9040-5087f4f16084 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:34.513796 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a0067720-53cb-4bb6-9040-5087f4f16084 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:34.639752 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0f62f972-c629-4de6-94cb-5ed54f2d4797 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:34.641220 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-a0067720-53cb-4bb6-9040-5087f4f16084 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:34.647271 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0f62f972-c629-4de6-94cb-5ed54f2d4797 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1678 microversion: 2.1 time: 0.154429 Jan 28 01:07:34.647842 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 502/1040] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:34 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:34.648604 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a0067720-53cb-4bb6-9040-5087f4f16084 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1266 microversion: 2.1 time: 0.148077 Jan 28 01:07:34.649167 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 539/1041] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:34 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:07:35.665900 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-40a210e3-7a95-4e2e-a064-ff0904193c5e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:35.666566 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-93d0a2db-f859-42b9-af0f-ef0b6732c968 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:35.666968 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-40a210e3-7a95-4e2e-a064-ff0904193c5e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:35.667095 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-93d0a2db-f859-42b9-af0f-ef0b6732c968 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:35.672771 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93d0a2db-f859-42b9-af0f-ef0b6732c968 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:35.672902 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-40a210e3-7a95-4e2e-a064-ff0904193c5e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:35.673228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93d0a2db-f859-42b9-af0f-ef0b6732c968 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:35.673359 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-40a210e3-7a95-4e2e-a064-ff0904193c5e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:35.674015 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-40a210e3-7a95-4e2e-a064-ff0904193c5e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:35.674115 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93d0a2db-f859-42b9-af0f-ef0b6732c968 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:35.674456 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-93d0a2db-f859-42b9-af0f-ef0b6732c968 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:35.674556 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-40a210e3-7a95-4e2e-a064-ff0904193c5e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:35.809305 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-93d0a2db-f859-42b9-af0f-ef0b6732c968 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:35.810528 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-40a210e3-7a95-4e2e-a064-ff0904193c5e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:35.817502 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-93d0a2db-f859-42b9-af0f-ef0b6732c968 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1678 microversion: 2.1 time: 0.155316 Jan 28 01:07:35.818067 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 503/1042] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:35 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:35.818307 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-40a210e3-7a95-4e2e-a064-ff0904193c5e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1453 microversion: 2.1 time: 0.156136 Jan 28 01:07:35.818987 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 540/1043] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:35 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:35.834383 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cd281b82-0087-47cd-beeb-b644359819fd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:35.835049 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cd281b82-0087-47cd-beeb-b644359819fd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:35.840912 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cd281b82-0087-47cd-beeb-b644359819fd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:35.841360 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cd281b82-0087-47cd-beeb-b644359819fd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:35.842139 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cd281b82-0087-47cd-beeb-b644359819fd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:35.842572 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cd281b82-0087-47cd-beeb-b644359819fd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:35.971278 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-cd281b82-0087-47cd-beeb-b644359819fd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:35.979229 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cd281b82-0087-47cd-beeb-b644359819fd tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1453 microversion: 2.1 time: 0.148356 Jan 28 01:07:35.979792 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 504/1044] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:35 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:07:36.833703 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-4c7ef256-7950-440e-8e7e-687cccbdfd5e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:36.834521 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-4c7ef256-7950-440e-8e7e-687cccbdfd5e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:36.840811 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c7ef256-7950-440e-8e7e-687cccbdfd5e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:36.841261 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c7ef256-7950-440e-8e7e-687cccbdfd5e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:36.842040 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c7ef256-7950-440e-8e7e-687cccbdfd5e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:36.842475 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-4c7ef256-7950-440e-8e7e-687cccbdfd5e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:36.974642 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-4c7ef256-7950-440e-8e7e-687cccbdfd5e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:36.982445 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-4c7ef256-7950-440e-8e7e-687cccbdfd5e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1678 microversion: 2.1 time: 0.152443 Jan 28 01:07:36.983139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 541/1045] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:36 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:07:37.785507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-139dbb59-19e9-4fc7-83f8-a200489b71de req-9c42b83a-89d1-43b8-a638-4476e64fd467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3531392-d8a5-4709-a9d7-fda2d5d83dba", "tag": "79623ca0-bf5f-4222-a661-53089e18c3c2"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:37.787085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:07:37.787085 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:07:37.794352 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-139dbb59-19e9-4fc7-83f8-a200489b71de req-9c42b83a-89d1-43b8-a638-4476e64fd467 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:37.794797 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-139dbb59-19e9-4fc7-83f8-a200489b71de req-9c42b83a-89d1-43b8-a638-4476e64fd467 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:37.805497 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-139dbb59-19e9-4fc7-83f8-a200489b71de req-9c42b83a-89d1-43b8-a638-4476e64fd467 service nova] Creating event network-changed:79623ca0-bf5f-4222-a661-53089e18c3c2 for instance b3531392-d8a5-4709-a9d7-fda2d5d83dba on hv-cinder-81689 Jan 28 01:07:37.810604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-139dbb59-19e9-4fc7-83f8-a200489b71de req-9c42b83a-89d1-43b8-a638-4476e64fd467 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028697 Jan 28 01:07:37.811245 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 505/1046] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:07:37.999471 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-527f42ab-16aa-4398-90e8-6adfbd43538e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:38.000400 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-527f42ab-16aa-4398-90e8-6adfbd43538e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:38.007964 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-527f42ab-16aa-4398-90e8-6adfbd43538e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:38.008513 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-527f42ab-16aa-4398-90e8-6adfbd43538e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:38.009411 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-527f42ab-16aa-4398-90e8-6adfbd43538e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:38.009918 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-527f42ab-16aa-4398-90e8-6adfbd43538e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:38.167424 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-527f42ab-16aa-4398-90e8-6adfbd43538e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:38.180639 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-527f42ab-16aa-4398-90e8-6adfbd43538e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1655 microversion: 2.1 time: 0.185114 Jan 28 01:07:38.182925 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 542/1047] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:37 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1655 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:07:38.199615 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-65a3afc1-8765-43ee-9c37-470a0c37cee4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:38.206303 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-65a3afc1-8765-43ee-9c37-470a0c37cee4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:38.206768 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-65a3afc1-8765-43ee-9c37-470a0c37cee4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:38.244308 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-65a3afc1-8765-43ee-9c37-470a0c37cee4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Going to try to start instance {{(pid=116253) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 01:07:38.318486 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-65a3afc1-8765-43ee-9c37-470a0c37cee4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action" status: 202 len: 0 microversion: 2.1 time: 0.123376 Jan 28 01:07:38.319444 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 506/1048] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:07:38 2022] POST /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:07:38.331387 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c56348da-91de-47d6-abbd-dc14b299bbe2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:38.332681 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c56348da-91de-47d6-abbd-dc14b299bbe2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:38.345583 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c56348da-91de-47d6-abbd-dc14b299bbe2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:38.346288 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c56348da-91de-47d6-abbd-dc14b299bbe2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:38.348079 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c56348da-91de-47d6-abbd-dc14b299bbe2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:38.348746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c56348da-91de-47d6-abbd-dc14b299bbe2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:38.546919 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-c56348da-91de-47d6-abbd-dc14b299bbe2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:38.554874 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c56348da-91de-47d6-abbd-dc14b299bbe2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1664 microversion: 2.1 time: 0.229851 Jan 28 01:07:38.564798 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 543/1049] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:38 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1664 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:39.572773 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-fab148d6-f3b2-4b49-aded-513ece751b41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:39.573550 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-fab148d6-f3b2-4b49-aded-513ece751b41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:39.586484 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fab148d6-f3b2-4b49-aded-513ece751b41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:39.586844 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fab148d6-f3b2-4b49-aded-513ece751b41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:39.587655 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fab148d6-f3b2-4b49-aded-513ece751b41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:39.588105 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fab148d6-f3b2-4b49-aded-513ece751b41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:39.923590 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-fab148d6-f3b2-4b49-aded-513ece751b41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:39.931089 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-fab148d6-f3b2-4b49-aded-513ece751b41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1668 microversion: 2.1 time: 0.362416 Jan 28 01:07:39.931663 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 507/1050] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:39 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1668 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:18.462616 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-03946e01-6198-474d-ab30-c9271b9114af tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:18.463566 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-03946e01-6198-474d-ab30-c9271b9114af tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:18.469491 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-03946e01-6198-474d-ab30-c9271b9114af tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:18.469958 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-03946e01-6198-474d-ab30-c9271b9114af tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:18.470746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-03946e01-6198-474d-ab30-c9271b9114af tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:18.471227 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-03946e01-6198-474d-ab30-c9271b9114af tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:18.500650 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-03946e01-6198-474d-ab30-c9271b9114af tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041864 Jan 28 01:08:18.501212 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 544/1051] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:08:18 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:18.558513 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-df50522a-779e-41d3-8c61-9c4438c30380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:18.559100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-df50522a-779e-41d3-8c61-9c4438c30380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:18.565193 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-df50522a-779e-41d3-8c61-9c4438c30380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:18.566202 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-df50522a-779e-41d3-8c61-9c4438c30380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:18.567034 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-df50522a-779e-41d3-8c61-9c4438c30380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:18.567480 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-df50522a-779e-41d3-8c61-9c4438c30380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:18.591020 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-df50522a-779e-41d3-8c61-9c4438c30380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Going to try to terminate instance {{(pid=116253) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:08:18.664142 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-df50522a-779e-41d3-8c61-9c4438c30380 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 204 len: 0 microversion: 2.1 time: 0.109087 Jan 28 01:08:18.664727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 508/1052] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:08:18 2022] DELETE /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:08:18.673021 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-783eb45f-a77f-4e0e-a1d2-4c5792501c5d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:18.673652 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-783eb45f-a77f-4e0e-a1d2-4c5792501c5d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:18.680182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-783eb45f-a77f-4e0e-a1d2-4c5792501c5d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:18.680640 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-783eb45f-a77f-4e0e-a1d2-4c5792501c5d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:18.681431 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-783eb45f-a77f-4e0e-a1d2-4c5792501c5d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:18.681869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-783eb45f-a77f-4e0e-a1d2-4c5792501c5d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:18.863152 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-783eb45f-a77f-4e0e-a1d2-4c5792501c5d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:18.870472 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-783eb45f-a77f-4e0e-a1d2-4c5792501c5d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1674 microversion: 2.1 time: 0.201324 Jan 28 01:08:18.871074 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 545/1053] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:18 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:19.888512 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d539f0de-9247-4f28-a623-0587b9af6cf6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:19.889263 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d539f0de-9247-4f28-a623-0587b9af6cf6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:19.896355 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d539f0de-9247-4f28-a623-0587b9af6cf6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:19.896810 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d539f0de-9247-4f28-a623-0587b9af6cf6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:19.897604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d539f0de-9247-4f28-a623-0587b9af6cf6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:19.898047 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d539f0de-9247-4f28-a623-0587b9af6cf6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:20.027215 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-d539f0de-9247-4f28-a623-0587b9af6cf6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:20.035267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d539f0de-9247-4f28-a623-0587b9af6cf6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1674 microversion: 2.1 time: 0.150254 Jan 28 01:08:20.035837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 509/1054] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:19 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:21.051920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b7b4ca29-4ac4-477e-89d9-aa3856228edb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:21.052569 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b7b4ca29-4ac4-477e-89d9-aa3856228edb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:21.058984 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b7b4ca29-4ac4-477e-89d9-aa3856228edb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:21.059537 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b7b4ca29-4ac4-477e-89d9-aa3856228edb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:21.060278 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b7b4ca29-4ac4-477e-89d9-aa3856228edb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:21.060715 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b7b4ca29-4ac4-477e-89d9-aa3856228edb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:21.197576 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-b7b4ca29-4ac4-477e-89d9-aa3856228edb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:21.204920 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b7b4ca29-4ac4-477e-89d9-aa3856228edb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 200 len: 1674 microversion: 2.1 time: 0.156670 Jan 28 01:08:21.205525 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 546/1055] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:21 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:21.597348 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-4acbffaf-ab73-428f-a668-28507a401886 req-65b41de2-bc55-4953-91ce-5a5e75a7d274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1", "name": "network-vif-deleted", "tag": "28f0f27c-c64c-4ac9-a0d2-a2f7ab1a672c"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:21.600311 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:08:21.600311 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:08:21.607133 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-4acbffaf-ab73-428f-a668-28507a401886 req-65b41de2-bc55-4953-91ce-5a5e75a7d274 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:21.607583 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-4acbffaf-ab73-428f-a668-28507a401886 req-65b41de2-bc55-4953-91ce-5a5e75a7d274 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:21.619864 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-4acbffaf-ab73-428f-a668-28507a401886 req-65b41de2-bc55-4953-91ce-5a5e75a7d274 service nova] Creating event network-vif-deleted:28f0f27c-c64c-4ac9-a0d2-a2f7ab1a672c for instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 on hv-cinder-81689 Jan 28 01:08:21.625144 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-4acbffaf-ab73-428f-a668-28507a401886 req-65b41de2-bc55-4953-91ce-5a5e75a7d274 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031405 Jan 28 01:08:21.625802 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 510/1056] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:08:22.222576 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f436b92c-bf0e-41ca-8855-e3cca4b528f6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:22.223223 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f436b92c-bf0e-41ca-8855-e3cca4b528f6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:22.229462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f436b92c-bf0e-41ca-8855-e3cca4b528f6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:22.229913 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f436b92c-bf0e-41ca-8855-e3cca4b528f6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:22.230715 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f436b92c-bf0e-41ca-8855-e3cca4b528f6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:22.231166 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f436b92c-bf0e-41ca-8855-e3cca4b528f6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:22.244744 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-f436b92c-bf0e-41ca-8855-e3cca4b528f6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] HTTP exception thrown: Instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 could not be found. Jan 28 01:08:22.245330 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f436b92c-bf0e-41ca-8855-e3cca4b528f6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Returning 404 to user: Instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:08:22.246157 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f436b92c-bf0e-41ca-8855-e3cca4b528f6 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 404 len: 111 microversion: 2.1 time: 0.027878 Jan 28 01:08:22.246700 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 547/1057] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:22 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:08:22.256150 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b3e6fc54-5e4d-419c-9ecc-730dbd6c1391 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '.version_select at 0x7f1a093aae50>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:22.276761 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b3e6fc54-5e4d-419c-9ecc-730dbd6c1391 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228076951" status: 202 len: 0 microversion: 2.1 time: 0.025118 Jan 28 01:08:22.277677 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 511/1058] 10.222.0.78 () {58 vars in 1220 bytes} [Fri Jan 28 01:08:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228076951 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:08:22.931277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f9063db0-cbbe-4652-8113-3597bbf94464 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'create', calling method: .version_select at 0x7f1a093ef5e0>, body: {"keypair": {"name": "tempest-keypair-491038333"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:22.944690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-f9063db0-cbbe-4652-8113-3597bbf94464 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for project 4ad98bf7b3c546848923e916df460759. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:08:22.948488 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-f9063db0-cbbe-4652-8113-3597bbf94464 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for user 213001750f3f475b82276d5743358ec9 and project 4ad98bf7b3c546848923e916df460759. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:08:23.208243 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-f9063db0-cbbe-4652-8113-3597bbf94464 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for project 4ad98bf7b3c546848923e916df460759. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:08:23.211921 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.quota [None req-f9063db0-cbbe-4652-8113-3597bbf94464 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for user 213001750f3f475b82276d5743358ec9 and project 4ad98bf7b3c546848923e916df460759. Resources: {'key_pairs'} {{(pid=116254) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:08:23.225953 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f9063db0-cbbe-4652-8113-3597bbf94464 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.298300 Jan 28 01:08:23.232169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 548/1059] 10.222.0.78 () {60 vars in 1157 bytes} [Fri Jan 28 01:08:22 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:24.485666 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1801879524", "imageRef": "79c48e81-2efa-4213-b01d-60844b725f82", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f7c560b-cb68-4225-abc6-2cbb69c2b4f6"}], "security_groups": [{"name": "tempest-securitygroup--312846461"}], "key_name": "tempest-keypair-491038333", "user_data": "}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:24.584747 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] validate_networks() for [('1f7c560b-cb68-4225-abc6-2cbb69c2b4f6', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:08:24.996814 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:08:24.997267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:08:24.997780 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:08:24.998199 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:08:24.998615 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:08:25.007979 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:25.008436 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:25.009244 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:25.009676 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:25.025766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for project 4ad98bf7b3c546848923e916df460759. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:08:25.029635 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Getting quotas for user 213001750f3f475b82276d5743358ec9 and project 4ad98bf7b3c546848923e916df460759. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:08:25.041025 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:08:25.043440 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79c48e81-2efa-4213-b01d-60844b725f82',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:08:25.090776 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6c797935-213a-4064-b4d4-306eb3ac2c1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.609657 Jan 28 01:08:25.091450 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 512/1060] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:08:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:08:25.102012 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e9dacc8e-1a9f-45d9-8960-c74568b431c4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:25.102720 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e9dacc8e-1a9f-45d9-8960-c74568b431c4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:25.158138 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e9dacc8e-1a9f-45d9-8960-c74568b431c4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:25.165700 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e9dacc8e-1a9f-45d9-8960-c74568b431c4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1237 microversion: 2.1 time: 0.067805 Jan 28 01:08:25.166271 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 549/1061] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:25 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:26.182461 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-0d416d03-eada-4985-9710-3c89b756e45c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:26.183131 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-0d416d03-eada-4985-9710-3c89b756e45c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:26.192547 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0d416d03-eada-4985-9710-3c89b756e45c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:26.193000 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0d416d03-eada-4985-9710-3c89b756e45c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:26.194077 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0d416d03-eada-4985-9710-3c89b756e45c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:26.194596 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-0d416d03-eada-4985-9710-3c89b756e45c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:26.286263 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-0d416d03-eada-4985-9710-3c89b756e45c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:26.293851 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-0d416d03-eada-4985-9710-3c89b756e45c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1297 microversion: 2.1 time: 0.115524 Jan 28 01:08:26.294446 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 513/1062] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:26 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:27.310993 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e456ae60-0e84-48f3-aee9-0c21d185c1f4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:27.311565 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e456ae60-0e84-48f3-aee9-0c21d185c1f4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:27.318915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e456ae60-0e84-48f3-aee9-0c21d185c1f4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:27.319396 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e456ae60-0e84-48f3-aee9-0c21d185c1f4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:27.320194 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e456ae60-0e84-48f3-aee9-0c21d185c1f4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:27.320632 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e456ae60-0e84-48f3-aee9-0c21d185c1f4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:27.459337 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-e456ae60-0e84-48f3-aee9-0c21d185c1f4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:27.466962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e456ae60-0e84-48f3-aee9-0c21d185c1f4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1362 microversion: 2.1 time: 0.159716 Jan 28 01:08:27.467546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 550/1063] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:27 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:27.845257 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-dfe371ff-ed66-40ab-a1fd-34006ff06375 req-531157c4-5889-4a57-bda8-4ec184170374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776434ce-376a-4046-a629-90827f0d7754", "tag": "7d56a33f-b73a-4fad-8aa7-124e12773925"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:27.848082 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:08:27.848082 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:08:27.857187 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-dfe371ff-ed66-40ab-a1fd-34006ff06375 req-531157c4-5889-4a57-bda8-4ec184170374 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:27.857750 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-dfe371ff-ed66-40ab-a1fd-34006ff06375 req-531157c4-5889-4a57-bda8-4ec184170374 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:27.871375 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-dfe371ff-ed66-40ab-a1fd-34006ff06375 req-531157c4-5889-4a57-bda8-4ec184170374 service nova] Creating event network-changed:7d56a33f-b73a-4fad-8aa7-124e12773925 for instance 776434ce-376a-4046-a629-90827f0d7754 on hv-cinder-81689 Jan 28 01:08:27.876514 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-dfe371ff-ed66-40ab-a1fd-34006ff06375 req-531157c4-5889-4a57-bda8-4ec184170374 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034798 Jan 28 01:08:27.877122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 514/1064] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:08:28.482906 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-81d0f1c8-6df0-4180-bce8-4381a0a51650 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:28.483650 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-81d0f1c8-6df0-4180-bce8-4381a0a51650 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:28.489993 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-81d0f1c8-6df0-4180-bce8-4381a0a51650 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:28.490442 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-81d0f1c8-6df0-4180-bce8-4381a0a51650 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:28.491263 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-81d0f1c8-6df0-4180-bce8-4381a0a51650 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:28.491700 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-81d0f1c8-6df0-4180-bce8-4381a0a51650 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:28.622225 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-81d0f1c8-6df0-4180-bce8-4381a0a51650 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:28.630137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-81d0f1c8-6df0-4180-bce8-4381a0a51650 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1362 microversion: 2.1 time: 0.150961 Jan 28 01:08:28.630712 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 551/1065] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:28 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:29.648210 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-1f67d66f-a866-43cf-bc96-6b7d5966985a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:29.648836 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-1f67d66f-a866-43cf-bc96-6b7d5966985a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:29.655151 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1f67d66f-a866-43cf-bc96-6b7d5966985a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:29.655607 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1f67d66f-a866-43cf-bc96-6b7d5966985a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:29.656651 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1f67d66f-a866-43cf-bc96-6b7d5966985a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:29.657100 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-1f67d66f-a866-43cf-bc96-6b7d5966985a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:29.784147 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-1f67d66f-a866-43cf-bc96-6b7d5966985a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:29.792056 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-1f67d66f-a866-43cf-bc96-6b7d5966985a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1362 microversion: 2.1 time: 0.149030 Jan 28 01:08:29.792617 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 515/1066] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:29 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:30.809428 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-9df62b3e-4d43-4d81-a02d-345f0c9a79dd tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:30.810083 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-9df62b3e-4d43-4d81-a02d-345f0c9a79dd tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:30.817057 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9df62b3e-4d43-4d81-a02d-345f0c9a79dd tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:30.817509 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9df62b3e-4d43-4d81-a02d-345f0c9a79dd tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:30.818288 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9df62b3e-4d43-4d81-a02d-345f0c9a79dd tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:30.818726 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-9df62b3e-4d43-4d81-a02d-345f0c9a79dd tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:30.944545 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-9df62b3e-4d43-4d81-a02d-345f0c9a79dd tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:30.951933 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-9df62b3e-4d43-4d81-a02d-345f0c9a79dd tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1362 microversion: 2.1 time: 0.146262 Jan 28 01:08:30.952497 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 552/1067] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:30 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:31.968952 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-34db7d48-9e23-49db-83c9-8bf8493cea21 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:31.969599 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-34db7d48-9e23-49db-83c9-8bf8493cea21 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:31.976008 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34db7d48-9e23-49db-83c9-8bf8493cea21 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:31.976531 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34db7d48-9e23-49db-83c9-8bf8493cea21 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:31.977325 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34db7d48-9e23-49db-83c9-8bf8493cea21 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:31.977768 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-34db7d48-9e23-49db-83c9-8bf8493cea21 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:32.111378 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-34db7d48-9e23-49db-83c9-8bf8493cea21 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:32.118844 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-34db7d48-9e23-49db-83c9-8bf8493cea21 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1362 microversion: 2.1 time: 0.153589 Jan 28 01:08:32.119442 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 516/1068] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:31 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:33.135320 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d95f5f21-0269-49de-b81d-bcc48434494d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:33.135963 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d95f5f21-0269-49de-b81d-bcc48434494d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:33.142327 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d95f5f21-0269-49de-b81d-bcc48434494d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:33.142784 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d95f5f21-0269-49de-b81d-bcc48434494d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:33.143684 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d95f5f21-0269-49de-b81d-bcc48434494d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:33.144137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d95f5f21-0269-49de-b81d-bcc48434494d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:33.272483 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d95f5f21-0269-49de-b81d-bcc48434494d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:33.279933 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d95f5f21-0269-49de-b81d-bcc48434494d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1362 microversion: 2.1 time: 0.148253 Jan 28 01:08:33.280500 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 553/1069] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:33 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:33.740110 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-b58f2a9a-cd76-4ca5-95be-edd1c2f2dfe2 req-dd96b7ae-b57e-4845-a27b-11b82900bca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776434ce-376a-4046-a629-90827f0d7754", "name": "network-vif-plugged", "status": "completed", "tag": "7d56a33f-b73a-4fad-8aa7-124e12773925"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:33.741658 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:08:33.741658 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:08:33.749304 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-b58f2a9a-cd76-4ca5-95be-edd1c2f2dfe2 req-dd96b7ae-b57e-4845-a27b-11b82900bca9 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:33.750033 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-b58f2a9a-cd76-4ca5-95be-edd1c2f2dfe2 req-dd96b7ae-b57e-4845-a27b-11b82900bca9 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:33.761511 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-b58f2a9a-cd76-4ca5-95be-edd1c2f2dfe2 req-dd96b7ae-b57e-4845-a27b-11b82900bca9 service nova] Creating event network-vif-plugged:7d56a33f-b73a-4fad-8aa7-124e12773925 for instance 776434ce-376a-4046-a629-90827f0d7754 on hv-cinder-81689 Jan 28 01:08:33.766520 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-b58f2a9a-cd76-4ca5-95be-edd1c2f2dfe2 req-dd96b7ae-b57e-4845-a27b-11b82900bca9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030682 Jan 28 01:08:33.767207 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 517/1070] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:08:34.297194 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-15ddedb6-06f4-4690-bb59-5ac46d6694a1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:34.297736 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-15ddedb6-06f4-4690-bb59-5ac46d6694a1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:34.304546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-15ddedb6-06f4-4690-bb59-5ac46d6694a1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:34.304997 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-15ddedb6-06f4-4690-bb59-5ac46d6694a1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:34.305776 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-15ddedb6-06f4-4690-bb59-5ac46d6694a1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:34.306213 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-15ddedb6-06f4-4690-bb59-5ac46d6694a1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:34.435072 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-15ddedb6-06f4-4690-bb59-5ac46d6694a1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:34.442852 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-15ddedb6-06f4-4690-bb59-5ac46d6694a1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1362 microversion: 2.1 time: 0.149417 Jan 28 01:08:34.443439 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 554/1071] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:34 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:35.460578 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c943ca76-e288-4312-934c-ca0c924bea41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:35.461322 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c943ca76-e288-4312-934c-ca0c924bea41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:35.467742 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c943ca76-e288-4312-934c-ca0c924bea41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:35.468201 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c943ca76-e288-4312-934c-ca0c924bea41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:35.468994 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c943ca76-e288-4312-934c-ca0c924bea41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:35.469440 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c943ca76-e288-4312-934c-ca0c924bea41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:35.599267 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-c943ca76-e288-4312-934c-ca0c924bea41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:08:35.606467 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c943ca76-e288-4312-934c-ca0c924bea41 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1548 microversion: 2.1 time: 0.150429 Jan 28 01:08:35.607058 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 518/1072] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:08:35 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:08:35.622923 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-12f39ee9-1030-4fe8-8ee9-09210d269151 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:08:35.623444 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-12f39ee9-1030-4fe8-8ee9-09210d269151 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:35.629705 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-12f39ee9-1030-4fe8-8ee9-09210d269151 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:35.630158 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-12f39ee9-1030-4fe8-8ee9-09210d269151 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:35.630962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-12f39ee9-1030-4fe8-8ee9-09210d269151 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:35.631407 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-12f39ee9-1030-4fe8-8ee9-09210d269151 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:35.707594 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-12f39ee9-1030-4fe8-8ee9-09210d269151 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088211 Jan 28 01:08:35.708285 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 555/1073] 10.222.0.78 () {58 vars in 1274 bytes} [Fri Jan 28 01:08:35 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:08:36.866040 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-f8fc9fc8-aeee-4844-855f-8a786d8c76b2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:36.872974 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-f8fc9fc8-aeee-4844-855f-8a786d8c76b2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:36.880276 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f8fc9fc8-aeee-4844-855f-8a786d8c76b2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:36.880563 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f8fc9fc8-aeee-4844-855f-8a786d8c76b2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:36.881371 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f8fc9fc8-aeee-4844-855f-8a786d8c76b2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:36.881817 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-f8fc9fc8-aeee-4844-855f-8a786d8c76b2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:36.935855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-f1e519ab-6e34-4751-b927-1aebc77522cf req-16071aeb-52ba-42cb-891c-d3147890c5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776434ce-376a-4046-a629-90827f0d7754", "tag": "7d56a33f-b73a-4fad-8aa7-124e12773925"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:36.937404 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:08:36.937404 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:08:36.944699 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-f1e519ab-6e34-4751-b927-1aebc77522cf req-16071aeb-52ba-42cb-891c-d3147890c5ba service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:36.945145 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-f1e519ab-6e34-4751-b927-1aebc77522cf req-16071aeb-52ba-42cb-891c-d3147890c5ba service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:36.956567 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-f1e519ab-6e34-4751-b927-1aebc77522cf req-16071aeb-52ba-42cb-891c-d3147890c5ba service nova] Creating event network-changed:7d56a33f-b73a-4fad-8aa7-124e12773925 for instance 776434ce-376a-4046-a629-90827f0d7754 on hv-cinder-81689 Jan 28 01:08:36.961630 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-f1e519ab-6e34-4751-b927-1aebc77522cf req-16071aeb-52ba-42cb-891c-d3147890c5ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093638 Jan 28 01:08:36.963358 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 556/1074] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:08:36.964319 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-f8fc9fc8-aeee-4844-855f-8a786d8c76b2 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.101938 Jan 28 01:08:36.967483 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 519/1075] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:36 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:37.976822 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f6e5a1f5-70f2-4c2a-a655-69a7f91c3a1d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:37.979063 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f6e5a1f5-70f2-4c2a-a655-69a7f91c3a1d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:37.985803 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6e5a1f5-70f2-4c2a-a655-69a7f91c3a1d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:37.986270 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6e5a1f5-70f2-4c2a-a655-69a7f91c3a1d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:37.987236 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6e5a1f5-70f2-4c2a-a655-69a7f91c3a1d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:37.987690 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f6e5a1f5-70f2-4c2a-a655-69a7f91c3a1d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:38.065765 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f6e5a1f5-70f2-4c2a-a655-69a7f91c3a1d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.093901 Jan 28 01:08:38.066407 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 557/1076] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:37 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:39.076647 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-cca6bd67-aae3-499b-80b9-de18157c2aa3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:39.077538 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-cca6bd67-aae3-499b-80b9-de18157c2aa3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:39.085101 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cca6bd67-aae3-499b-80b9-de18157c2aa3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:39.085554 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cca6bd67-aae3-499b-80b9-de18157c2aa3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:39.086342 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cca6bd67-aae3-499b-80b9-de18157c2aa3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:39.086783 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-cca6bd67-aae3-499b-80b9-de18157c2aa3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:39.179387 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-cca6bd67-aae3-499b-80b9-de18157c2aa3 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.106680 Jan 28 01:08:39.180011 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 520/1077] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:39 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:40.190761 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-fba2ec4c-5bf8-43f1-9e44-10350af67396 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:40.191700 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-fba2ec4c-5bf8-43f1-9e44-10350af67396 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:40.203070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fba2ec4c-5bf8-43f1-9e44-10350af67396 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:40.203070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fba2ec4c-5bf8-43f1-9e44-10350af67396 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:40.203070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fba2ec4c-5bf8-43f1-9e44-10350af67396 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:40.203070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-fba2ec4c-5bf8-43f1-9e44-10350af67396 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:40.290687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-fba2ec4c-5bf8-43f1-9e44-10350af67396 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.103952 Jan 28 01:08:40.291373 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 558/1078] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:40 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:41.301565 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-06e9b9cc-2a4a-4e11-812b-65a1a4c501cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:41.302594 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-06e9b9cc-2a4a-4e11-812b-65a1a4c501cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:41.309490 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-06e9b9cc-2a4a-4e11-812b-65a1a4c501cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:41.309947 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-06e9b9cc-2a4a-4e11-812b-65a1a4c501cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:41.310728 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-06e9b9cc-2a4a-4e11-812b-65a1a4c501cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:41.311198 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-06e9b9cc-2a4a-4e11-812b-65a1a4c501cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:41.400477 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-06e9b9cc-2a4a-4e11-812b-65a1a4c501cc tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.102783 Jan 28 01:08:41.401271 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 521/1079] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:41 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:42.411491 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2c7ca23c-6a0f-4696-b0e4-fcbffcb4bcb1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:42.412559 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2c7ca23c-6a0f-4696-b0e4-fcbffcb4bcb1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:42.419604 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2c7ca23c-6a0f-4696-b0e4-fcbffcb4bcb1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:42.420057 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2c7ca23c-6a0f-4696-b0e4-fcbffcb4bcb1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:42.420851 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2c7ca23c-6a0f-4696-b0e4-fcbffcb4bcb1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:42.421290 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2c7ca23c-6a0f-4696-b0e4-fcbffcb4bcb1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:42.501498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2c7ca23c-6a0f-4696-b0e4-fcbffcb4bcb1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.093968 Jan 28 01:08:42.502170 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 559/1080] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:42 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:43.513933 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-d3b63e61-782c-4943-a9d7-f1d31bad46fe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:43.514987 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-d3b63e61-782c-4943-a9d7-f1d31bad46fe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:43.522149 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d3b63e61-782c-4943-a9d7-f1d31bad46fe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:43.522595 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d3b63e61-782c-4943-a9d7-f1d31bad46fe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:43.523456 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d3b63e61-782c-4943-a9d7-f1d31bad46fe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:43.523894 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-d3b63e61-782c-4943-a9d7-f1d31bad46fe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:43.604941 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-d3b63e61-782c-4943-a9d7-f1d31bad46fe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.095025 Jan 28 01:08:43.605561 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 522/1081] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:43 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:44.617216 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-eb915c24-207d-43f9-b809-a436c3a98da5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:44.618223 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-eb915c24-207d-43f9-b809-a436c3a98da5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:44.625147 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eb915c24-207d-43f9-b809-a436c3a98da5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:44.625607 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eb915c24-207d-43f9-b809-a436c3a98da5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:44.626392 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eb915c24-207d-43f9-b809-a436c3a98da5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:44.626837 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eb915c24-207d-43f9-b809-a436c3a98da5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:44.714998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-eb915c24-207d-43f9-b809-a436c3a98da5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.101485 Jan 28 01:08:44.715986 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 560/1082] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:44 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:45.727233 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-7c13ab45-1204-4c58-8eca-1fdcb9e5272c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:45.728446 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-7c13ab45-1204-4c58-8eca-1fdcb9e5272c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:45.735280 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c13ab45-1204-4c58-8eca-1fdcb9e5272c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:45.735730 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c13ab45-1204-4c58-8eca-1fdcb9e5272c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:45.736518 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c13ab45-1204-4c58-8eca-1fdcb9e5272c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:45.736956 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-7c13ab45-1204-4c58-8eca-1fdcb9e5272c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:45.820155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-7c13ab45-1204-4c58-8eca-1fdcb9e5272c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.096894 Jan 28 01:08:45.820790 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 523/1083] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:45 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:46.831246 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-f4eb10c5-9b8d-4bc4-bed7-1710aaa5defe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:46.832252 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-f4eb10c5-9b8d-4bc4-bed7-1710aaa5defe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:46.839501 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f4eb10c5-9b8d-4bc4-bed7-1710aaa5defe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:46.839963 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f4eb10c5-9b8d-4bc4-bed7-1710aaa5defe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:46.840751 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f4eb10c5-9b8d-4bc4-bed7-1710aaa5defe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:46.841201 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-f4eb10c5-9b8d-4bc4-bed7-1710aaa5defe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:46.925399 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-f4eb10c5-9b8d-4bc4-bed7-1710aaa5defe tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 14 microversion: 2.1 time: 0.097483 Jan 28 01:08:46.926517 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 561/1084] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:46 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:08:47.936222 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-826d8927-2921-4351-aef9-20b5df6d6a3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:47.937244 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-826d8927-2921-4351-aef9-20b5df6d6a3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:47.944197 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-826d8927-2921-4351-aef9-20b5df6d6a3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:47.944658 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-826d8927-2921-4351-aef9-20b5df6d6a3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:47.945454 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-826d8927-2921-4351-aef9-20b5df6d6a3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:47.945900 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-826d8927-2921-4351-aef9-20b5df6d6a3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:48.047144 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-826d8927-2921-4351-aef9-20b5df6d6a3e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 11723 microversion: 2.1 time: 0.114906 Jan 28 01:08:48.047804 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 524/1085] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:47 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 11723 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:08:49.058227 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-da6676b0-3b60-47c7-b794-d5b13ed23ef4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:49.059317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-da6676b0-3b60-47c7-b794-d5b13ed23ef4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:49.066164 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-da6676b0-3b60-47c7-b794-d5b13ed23ef4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:49.066624 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-da6676b0-3b60-47c7-b794-d5b13ed23ef4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:49.067444 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-da6676b0-3b60-47c7-b794-d5b13ed23ef4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:49.067890 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-da6676b0-3b60-47c7-b794-d5b13ed23ef4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:49.168588 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-da6676b0-3b60-47c7-b794-d5b13ed23ef4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 18003 microversion: 2.1 time: 0.114242 Jan 28 01:08:49.169147 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 562/1086] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:49 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 18003 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:08:50.180946 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c77c66ef-43ff-4dc1-9a30-9e4fe20708d5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:50.181960 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c77c66ef-43ff-4dc1-9a30-9e4fe20708d5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:50.189174 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c77c66ef-43ff-4dc1-9a30-9e4fe20708d5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:50.189633 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c77c66ef-43ff-4dc1-9a30-9e4fe20708d5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:50.190471 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c77c66ef-43ff-4dc1-9a30-9e4fe20708d5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:50.190947 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c77c66ef-43ff-4dc1-9a30-9e4fe20708d5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:50.290112 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c77c66ef-43ff-4dc1-9a30-9e4fe20708d5 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 18827 microversion: 2.1 time: 0.113129 Jan 28 01:08:50.290772 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 525/1087] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:50 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 18827 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:08:51.302195 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2cd399de-bfaf-4558-aef0-fdcd7d9e8b20 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:51.303227 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2cd399de-bfaf-4558-aef0-fdcd7d9e8b20 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:51.310152 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2cd399de-bfaf-4558-aef0-fdcd7d9e8b20 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:51.310611 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2cd399de-bfaf-4558-aef0-fdcd7d9e8b20 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:51.311429 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2cd399de-bfaf-4558-aef0-fdcd7d9e8b20 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:51.311875 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2cd399de-bfaf-4558-aef0-fdcd7d9e8b20 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:51.415492 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2cd399de-bfaf-4558-aef0-fdcd7d9e8b20 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 21674 microversion: 2.1 time: 0.117658 Jan 28 01:08:51.416172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 563/1088] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:51 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 21674 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:08:52.428052 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c75fb087-d8de-4b26-b0fd-f23faf6412ea tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:52.429062 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c75fb087-d8de-4b26-b0fd-f23faf6412ea tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:52.435998 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c75fb087-d8de-4b26-b0fd-f23faf6412ea tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:52.436451 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c75fb087-d8de-4b26-b0fd-f23faf6412ea tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:52.437256 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c75fb087-d8de-4b26-b0fd-f23faf6412ea tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:52.437705 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c75fb087-d8de-4b26-b0fd-f23faf6412ea tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:52.534678 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c75fb087-d8de-4b26-b0fd-f23faf6412ea tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 23228 microversion: 2.1 time: 0.110496 Jan 28 01:08:52.535369 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 526/1089] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:52 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 23228 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:08:53.546678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1de54b99-1e52-40c2-ade7-998872567672 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:53.547708 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1de54b99-1e52-40c2-ade7-998872567672 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:53.554578 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1de54b99-1e52-40c2-ade7-998872567672 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:53.555053 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1de54b99-1e52-40c2-ade7-998872567672 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:53.555838 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1de54b99-1e52-40c2-ade7-998872567672 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:53.556272 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1de54b99-1e52-40c2-ade7-998872567672 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:53.650242 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1de54b99-1e52-40c2-ade7-998872567672 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 24729 microversion: 2.1 time: 0.107294 Jan 28 01:08:53.650795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 564/1090] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:53 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 24729 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:08:54.663392 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e0cde5f9-c93c-42c0-be91-fe4e8885a91e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:54.664404 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e0cde5f9-c93c-42c0-be91-fe4e8885a91e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:54.671335 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0cde5f9-c93c-42c0-be91-fe4e8885a91e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:54.671795 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0cde5f9-c93c-42c0-be91-fe4e8885a91e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:54.672614 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0cde5f9-c93c-42c0-be91-fe4e8885a91e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:54.673061 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e0cde5f9-c93c-42c0-be91-fe4e8885a91e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:54.765980 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e0cde5f9-c93c-42c0-be91-fe4e8885a91e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 26329 microversion: 2.1 time: 0.107015 Jan 28 01:08:54.766647 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 527/1091] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:54 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 26329 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:08:55.778315 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e4cddb96-0479-4f50-afb6-af989621df9c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:55.779340 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e4cddb96-0479-4f50-afb6-af989621df9c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:55.787405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e4cddb96-0479-4f50-afb6-af989621df9c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:55.787856 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e4cddb96-0479-4f50-afb6-af989621df9c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:55.788678 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e4cddb96-0479-4f50-afb6-af989621df9c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:55.789111 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e4cddb96-0479-4f50-afb6-af989621df9c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:55.894619 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e4cddb96-0479-4f50-afb6-af989621df9c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 27498 microversion: 2.1 time: 0.120197 Jan 28 01:08:55.895320 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 565/1092] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:55 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 27498 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:08:56.907646 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c0563ee7-3033-4049-8c4e-84c3e5138fd9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:56.908701 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c0563ee7-3033-4049-8c4e-84c3e5138fd9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:56.916133 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c0563ee7-3033-4049-8c4e-84c3e5138fd9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:56.916588 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c0563ee7-3033-4049-8c4e-84c3e5138fd9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:56.917386 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c0563ee7-3033-4049-8c4e-84c3e5138fd9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:56.917833 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c0563ee7-3033-4049-8c4e-84c3e5138fd9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:57.015298 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c0563ee7-3033-4049-8c4e-84c3e5138fd9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 28020 microversion: 2.1 time: 0.111773 Jan 28 01:08:57.015957 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 528/1093] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:56 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 28020 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:08:58.028105 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a2444a4e-c11f-4e3a-8ac6-8b36100e4376 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:58.029103 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a2444a4e-c11f-4e3a-8ac6-8b36100e4376 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:58.036786 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2444a4e-c11f-4e3a-8ac6-8b36100e4376 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:58.037241 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2444a4e-c11f-4e3a-8ac6-8b36100e4376 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:58.038013 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2444a4e-c11f-4e3a-8ac6-8b36100e4376 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:58.038450 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a2444a4e-c11f-4e3a-8ac6-8b36100e4376 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:58.134215 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a2444a4e-c11f-4e3a-8ac6-8b36100e4376 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 28209 microversion: 2.1 time: 0.109997 Jan 28 01:08:58.134870 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 566/1094] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:58 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 28209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:08:59.147169 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-56276a0f-84bc-4b28-9d86-960f01160976 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:08:59.148227 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-56276a0f-84bc-4b28-9d86-960f01160976 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:08:59.155417 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-56276a0f-84bc-4b28-9d86-960f01160976 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:59.155878 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-56276a0f-84bc-4b28-9d86-960f01160976 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:59.157000 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-56276a0f-84bc-4b28-9d86-960f01160976 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:08:59.157442 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-56276a0f-84bc-4b28-9d86-960f01160976 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:08:59.254304 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-56276a0f-84bc-4b28-9d86-960f01160976 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 28209 microversion: 2.1 time: 0.111604 Jan 28 01:08:59.254993 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 529/1095] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:08:59 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 28209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:00.266347 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8b6363d2-2428-4bd7-b64b-2fdfd071f3ef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:00.267399 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8b6363d2-2428-4bd7-b64b-2fdfd071f3ef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:00.274275 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b6363d2-2428-4bd7-b64b-2fdfd071f3ef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:00.274728 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b6363d2-2428-4bd7-b64b-2fdfd071f3ef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:00.275530 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b6363d2-2428-4bd7-b64b-2fdfd071f3ef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:00.275966 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8b6363d2-2428-4bd7-b64b-2fdfd071f3ef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:00.370034 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8b6363d2-2428-4bd7-b64b-2fdfd071f3ef tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 28500 microversion: 2.1 time: 0.107523 Jan 28 01:09:00.370699 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 567/1096] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:00 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 28500 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:01.382285 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-29058e0a-e58f-4a94-ad22-cd2996b08dde tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:01.383389 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-29058e0a-e58f-4a94-ad22-cd2996b08dde tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:01.390347 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-29058e0a-e58f-4a94-ad22-cd2996b08dde tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:01.390800 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-29058e0a-e58f-4a94-ad22-cd2996b08dde tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:01.391623 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-29058e0a-e58f-4a94-ad22-cd2996b08dde tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:01.392069 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-29058e0a-e58f-4a94-ad22-cd2996b08dde tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:01.492238 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-29058e0a-e58f-4a94-ad22-cd2996b08dde tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 28668 microversion: 2.1 time: 0.113822 Jan 28 01:09:01.493179 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 530/1097] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:01 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 28668 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:02.504427 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ce1c851b-4171-4447-a7dd-fa9df17ce56d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:02.505574 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ce1c851b-4171-4447-a7dd-fa9df17ce56d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:02.512661 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ce1c851b-4171-4447-a7dd-fa9df17ce56d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:02.513117 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ce1c851b-4171-4447-a7dd-fa9df17ce56d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:02.513915 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ce1c851b-4171-4447-a7dd-fa9df17ce56d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:02.514358 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ce1c851b-4171-4447-a7dd-fa9df17ce56d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:02.601207 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ce1c851b-4171-4447-a7dd-fa9df17ce56d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 28668 microversion: 2.1 time: 0.100604 Jan 28 01:09:02.601860 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 568/1098] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:02 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 28668 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:09:03.614002 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-fdcfaa06-f8c6-4a57-9141-29650c6f5e60 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:03.615043 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-fdcfaa06-f8c6-4a57-9141-29650c6f5e60 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:03.621983 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fdcfaa06-f8c6-4a57-9141-29650c6f5e60 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:03.622442 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fdcfaa06-f8c6-4a57-9141-29650c6f5e60 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:03.623271 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fdcfaa06-f8c6-4a57-9141-29650c6f5e60 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:03.623720 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fdcfaa06-f8c6-4a57-9141-29650c6f5e60 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:03.707348 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-fdcfaa06-f8c6-4a57-9141-29650c6f5e60 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 28668 microversion: 2.1 time: 0.097602 Jan 28 01:09:03.707913 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 531/1099] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:03 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 28668 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:04.720410 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-416b9a69-f43a-4503-866f-6753e04a39d4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:04.721413 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-416b9a69-f43a-4503-866f-6753e04a39d4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:04.728476 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-416b9a69-f43a-4503-866f-6753e04a39d4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:04.728936 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-416b9a69-f43a-4503-866f-6753e04a39d4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:04.729727 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-416b9a69-f43a-4503-866f-6753e04a39d4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:04.730172 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-416b9a69-f43a-4503-866f-6753e04a39d4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:04.831917 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-416b9a69-f43a-4503-866f-6753e04a39d4 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 30072 microversion: 2.1 time: 0.115333 Jan 28 01:09:04.832608 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 569/1100] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:04 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 30072 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:05.844105 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-65cdf6e9-809d-4047-8066-b8bc75752f64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:05.845115 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-65cdf6e9-809d-4047-8066-b8bc75752f64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:05.852142 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-65cdf6e9-809d-4047-8066-b8bc75752f64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:05.852603 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-65cdf6e9-809d-4047-8066-b8bc75752f64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:05.853395 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-65cdf6e9-809d-4047-8066-b8bc75752f64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:05.853840 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-65cdf6e9-809d-4047-8066-b8bc75752f64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:05.951758 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-65cdf6e9-809d-4047-8066-b8bc75752f64 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 32247 microversion: 2.1 time: 0.111466 Jan 28 01:09:05.952499 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 532/1101] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:05 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 32247 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:09:06.963963 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-c144c886-0020-435d-b2eb-5e03eccd6355 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:06.964973 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-c144c886-0020-435d-b2eb-5e03eccd6355 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:06.971985 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c144c886-0020-435d-b2eb-5e03eccd6355 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:06.972449 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c144c886-0020-435d-b2eb-5e03eccd6355 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:06.973245 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c144c886-0020-435d-b2eb-5e03eccd6355 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:06.973687 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-c144c886-0020-435d-b2eb-5e03eccd6355 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:07.061403 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-c144c886-0020-435d-b2eb-5e03eccd6355 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 33618 microversion: 2.1 time: 0.101294 Jan 28 01:09:07.062058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 570/1102] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:06 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 33618 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:08.074186 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4d9e9815-eb26-4fd1-bd30-53b8f6e8642b tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:08.075213 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4d9e9815-eb26-4fd1-bd30-53b8f6e8642b tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:08.082676 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4d9e9815-eb26-4fd1-bd30-53b8f6e8642b tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:08.083156 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4d9e9815-eb26-4fd1-bd30-53b8f6e8642b tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:08.083973 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4d9e9815-eb26-4fd1-bd30-53b8f6e8642b tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:08.084414 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4d9e9815-eb26-4fd1-bd30-53b8f6e8642b tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:08.177555 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4d9e9815-eb26-4fd1-bd30-53b8f6e8642b tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 34766 microversion: 2.1 time: 0.107219 Jan 28 01:09:08.178289 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 533/1103] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:08 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 34766 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:09:09.191365 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-eaecd50b-da3d-4a2c-b7df-a0b20832c373 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:09.192360 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-eaecd50b-da3d-4a2c-b7df-a0b20832c373 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:09.199258 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eaecd50b-da3d-4a2c-b7df-a0b20832c373 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:09.199709 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eaecd50b-da3d-4a2c-b7df-a0b20832c373 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:09.200492 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eaecd50b-da3d-4a2c-b7df-a0b20832c373 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:09.200932 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-eaecd50b-da3d-4a2c-b7df-a0b20832c373 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:09.301886 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-eaecd50b-da3d-4a2c-b7df-a0b20832c373 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 35919 microversion: 2.1 time: 0.114964 Jan 28 01:09:09.302746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 571/1104] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:09 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 35919 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:10.313994 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-97551983-4597-4425-9924-dc35122bb001 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:10.315036 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-97551983-4597-4425-9924-dc35122bb001 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:10.321959 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97551983-4597-4425-9924-dc35122bb001 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:10.322416 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97551983-4597-4425-9924-dc35122bb001 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:10.323241 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97551983-4597-4425-9924-dc35122bb001 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:10.323689 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-97551983-4597-4425-9924-dc35122bb001 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:10.415995 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-97551983-4597-4425-9924-dc35122bb001 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 37698 microversion: 2.1 time: 0.105913 Jan 28 01:09:10.416664 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 534/1105] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:10 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 37698 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:11.429640 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e13c072b-62ee-45cc-afef-0dc17d30ab77 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:11.430772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e13c072b-62ee-45cc-afef-0dc17d30ab77 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:11.438625 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e13c072b-62ee-45cc-afef-0dc17d30ab77 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:11.439019 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e13c072b-62ee-45cc-afef-0dc17d30ab77 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:11.439929 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e13c072b-62ee-45cc-afef-0dc17d30ab77 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:11.440412 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e13c072b-62ee-45cc-afef-0dc17d30ab77 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:11.550498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e13c072b-62ee-45cc-afef-0dc17d30ab77 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 38203 microversion: 2.1 time: 0.125872 Jan 28 01:09:11.551169 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 572/1106] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:11 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 38203 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:12.563210 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3b9e7ebf-dd39-49b8-b7ef-609ee35c9bae tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:12.564184 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3b9e7ebf-dd39-49b8-b7ef-609ee35c9bae tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:12.571879 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3b9e7ebf-dd39-49b8-b7ef-609ee35c9bae tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:12.572333 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3b9e7ebf-dd39-49b8-b7ef-609ee35c9bae tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:12.573160 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3b9e7ebf-dd39-49b8-b7ef-609ee35c9bae tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:12.573605 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3b9e7ebf-dd39-49b8-b7ef-609ee35c9bae tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:12.659519 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3b9e7ebf-dd39-49b8-b7ef-609ee35c9bae tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 38203 microversion: 2.1 time: 0.100439 Jan 28 01:09:12.660181 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 535/1107] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:12 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 38203 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:13.672064 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2ad913f4-8d8f-46e3-857a-b6b9864fcc1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:13.672983 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2ad913f4-8d8f-46e3-857a-b6b9864fcc1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:13.680043 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2ad913f4-8d8f-46e3-857a-b6b9864fcc1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:13.680501 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2ad913f4-8d8f-46e3-857a-b6b9864fcc1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:13.681288 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2ad913f4-8d8f-46e3-857a-b6b9864fcc1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:13.681731 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-2ad913f4-8d8f-46e3-857a-b6b9864fcc1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:13.764949 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2ad913f4-8d8f-46e3-857a-b6b9864fcc1a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 38203 microversion: 2.1 time: 0.096994 Jan 28 01:09:13.765598 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 573/1108] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:13 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 38203 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:14.778260 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-e6384258-0d2a-4966-8a5c-3b20980e246d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:14.779455 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-e6384258-0d2a-4966-8a5c-3b20980e246d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:14.786743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e6384258-0d2a-4966-8a5c-3b20980e246d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:14.787231 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e6384258-0d2a-4966-8a5c-3b20980e246d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:14.788048 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e6384258-0d2a-4966-8a5c-3b20980e246d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:14.788491 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-e6384258-0d2a-4966-8a5c-3b20980e246d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:14.880802 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-e6384258-0d2a-4966-8a5c-3b20980e246d tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 38210 microversion: 2.1 time: 0.106409 Jan 28 01:09:14.881459 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 536/1109] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:14 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 38210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:15.893186 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d0a930fc-a4f8-43e5-b9e6-1db96aa426ce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:15.894191 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d0a930fc-a4f8-43e5-b9e6-1db96aa426ce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:15.901809 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d0a930fc-a4f8-43e5-b9e6-1db96aa426ce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:15.902266 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d0a930fc-a4f8-43e5-b9e6-1db96aa426ce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:15.903088 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d0a930fc-a4f8-43e5-b9e6-1db96aa426ce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:15.903532 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d0a930fc-a4f8-43e5-b9e6-1db96aa426ce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:16.002695 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d0a930fc-a4f8-43e5-b9e6-1db96aa426ce tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action" status: 200 len: 38334 microversion: 2.1 time: 0.112926 Jan 28 01:09:16.003377 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 574/1110] 10.222.0.78 () {60 vars in 1277 bytes} [Fri Jan 28 01:09:15 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/action => generated 38334 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:09:16.013788 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-c4c1e1be-871d-43f5-95cf-f463d1cb4c80 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:16.014376 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-c4c1e1be-871d-43f5-95cf-f463d1cb4c80 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:16.021818 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c4c1e1be-871d-43f5-95cf-f463d1cb4c80 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:16.022270 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c4c1e1be-871d-43f5-95cf-f463d1cb4c80 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:16.023089 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c4c1e1be-871d-43f5-95cf-f463d1cb4c80 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:16.023531 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-c4c1e1be-871d-43f5-95cf-f463d1cb4c80 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:16.047411 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-c4c1e1be-871d-43f5-95cf-f463d1cb4c80 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/ips" status: 200 len: 145 microversion: 2.1 time: 0.037621 Jan 28 01:09:16.047984 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 537/1111] 10.222.0.78 () {58 vars in 1247 bytes} [Fri Jan 28 01:09:16 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:17.356485 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ec0e4ebe-ca86-4dc8-b41e-338d4d48198a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eb6d9f7-00cf-4435-9631-677b4617a8c1"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:17.357623 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ec0e4ebe-ca86-4dc8-b41e-338d4d48198a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:17.364717 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ec0e4ebe-ca86-4dc8-b41e-338d4d48198a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:17.365168 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ec0e4ebe-ca86-4dc8-b41e-338d4d48198a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:17.365983 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ec0e4ebe-ca86-4dc8-b41e-338d4d48198a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:17.366420 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ec0e4ebe-ca86-4dc8-b41e-338d4d48198a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:17.635568 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ec0e4ebe-ca86-4dc8-b41e-338d4d48198a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282906 Jan 28 01:09:17.636203 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 575/1112] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:09:17 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:24.359563 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1451172468", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1017196631", "security_groups": [{"name": "tempest-secgroup-smoke-1597946477"}], "block_device_mapping_v2": [{"uuid": "000aacd5-4c82-4ccf-a316-91de751ecc29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3bb0bc5c-1a8f-440b-a693-6e8a7b68363c"}]}} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:24.469682 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.network.neutron [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] validate_networks() for [('3bb0bc5c-1a8f-440b-a693-6e8a7b68363c', None, None, None, None, None)] {{(pid=116253) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:09:24.835777 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Flavor limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:09:24.836210 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Image limits 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:09:24.836693 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Flavor pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:09:24.837110 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Image pref 0:0:0 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:09:24.837558 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.virt.hardware [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116253) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:09:24.846155 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:24.846609 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:24.847462 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:24.847905 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:24.867086 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:09:24.870959 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.quota [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Getting quotas for user 38bed71713534d0999a15ea8440717a5 and project 84aa61f3492a445c961e0e4b3682cfcb. Resources: {'cores', 'instances', 'ram'} {{(pid=116253) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:09:24.927847 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Going to run 1 instances... {{(pid=116253) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:09:24.929988 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='000aacd5-4c82-4ccf-a316-91de751ecc29',volume_size=None,volume_type=None)] {{(pid=116253) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:09:25.059964 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4e1fe0b9-8262-47c9-8df8-7555acf3eb9a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704107 Jan 28 01:09:25.060629 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 538/1113] 10.222.0.78 () {60 vars in 1146 bytes} [Fri Jan 28 01:09:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:09:25.071563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-2e0d78fe-79d9-41a1-a1f7-8b9bd7026d97 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:25.072270 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-2e0d78fe-79d9-41a1-a1f7-8b9bd7026d97 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:25.124788 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-2e0d78fe-79d9-41a1-a1f7-8b9bd7026d97 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:25.131441 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-2e0d78fe-79d9-41a1-a1f7-8b9bd7026d97 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1095 microversion: 2.1 time: 0.064372 Jan 28 01:09:25.132012 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 576/1114] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:25 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:26.149266 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-681dd788-084e-4190-a11b-f7ba50b8a9c3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:26.149890 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-681dd788-084e-4190-a11b-f7ba50b8a9c3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:26.155814 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-681dd788-084e-4190-a11b-f7ba50b8a9c3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:26.156272 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-681dd788-084e-4190-a11b-f7ba50b8a9c3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:26.157570 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-681dd788-084e-4190-a11b-f7ba50b8a9c3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:26.158027 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-681dd788-084e-4190-a11b-f7ba50b8a9c3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:26.254611 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-681dd788-084e-4190-a11b-f7ba50b8a9c3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:26.261909 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-681dd788-084e-4190-a11b-f7ba50b8a9c3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1211 microversion: 2.1 time: 0.116744 Jan 28 01:09:26.262517 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 539/1115] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:26 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:27.229503 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e72544c9-0f25-4678-904f-114e96a933c9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:27.230498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e72544c9-0f25-4678-904f-114e96a933c9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:27.237976 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e72544c9-0f25-4678-904f-114e96a933c9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:27.238432 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e72544c9-0f25-4678-904f-114e96a933c9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:27.239270 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e72544c9-0f25-4678-904f-114e96a933c9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:27.239950 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e72544c9-0f25-4678-904f-114e96a933c9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:27.274747 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e72544c9-0f25-4678-904f-114e96a933c9 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048521 Jan 28 01:09:27.275666 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 577/1116] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:09:27 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:27.281643 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-677e9368-dd40-4dbc-981f-8b7bdcadc313 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:27.284106 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-677e9368-dd40-4dbc-981f-8b7bdcadc313 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:27.285444 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-6f0ede96-729e-4826-bbb5-f950b319e42a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:27.286133 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-6f0ede96-729e-4826-bbb5-f950b319e42a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:27.292277 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6f0ede96-729e-4826-bbb5-f950b319e42a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:27.292811 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6f0ede96-729e-4826-bbb5-f950b319e42a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:27.293706 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6f0ede96-729e-4826-bbb5-f950b319e42a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:27.294146 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-677e9368-dd40-4dbc-981f-8b7bdcadc313 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:27.294293 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-6f0ede96-729e-4826-bbb5-f950b319e42a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:27.294941 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-677e9368-dd40-4dbc-981f-8b7bdcadc313 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:27.295945 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-677e9368-dd40-4dbc-981f-8b7bdcadc313 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:27.296549 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-677e9368-dd40-4dbc-981f-8b7bdcadc313 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:27.329250 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-6f0ede96-729e-4826-bbb5-f950b319e42a tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/0eb6d9f7-00cf-4435-9631-677b4617a8c1" status: 200 len: 194 microversion: 2.1 time: 0.046912 Jan 28 01:09:27.334930 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 578/1117] 10.222.0.78 () {58 vars in 1412 bytes} [Fri Jan 28 01:09:27 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/0eb6d9f7-00cf-4435-9631-677b4617a8c1 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:27.569939 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-f14ce585-fa2b-46b5-8ab4-0e38acd605c0 req-c03fe1cb-aee0-494f-8fe8-54db6a9d45bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de49f6ba-5872-4ce8-9ea2-92c22c008d6e", "tag": "c020ebfa-33a0-409c-b821-abfa02de16d9"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:27.571595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:09:27.571595 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:09:27.579608 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-677e9368-dd40-4dbc-981f-8b7bdcadc313 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:27.586317 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-f14ce585-fa2b-46b5-8ab4-0e38acd605c0 req-c03fe1cb-aee0-494f-8fe8-54db6a9d45bf service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:27.589740 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-f14ce585-fa2b-46b5-8ab4-0e38acd605c0 req-c03fe1cb-aee0-494f-8fe8-54db6a9d45bf service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:27.590032 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-677e9368-dd40-4dbc-981f-8b7bdcadc313 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1279 microversion: 2.1 time: 0.313538 Jan 28 01:09:27.591619 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 540/1118] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:27 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1279 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:09:27.604598 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-f14ce585-fa2b-46b5-8ab4-0e38acd605c0 req-c03fe1cb-aee0-494f-8fe8-54db6a9d45bf service nova] Creating event network-changed:c020ebfa-33a0-409c-b821-abfa02de16d9 for instance de49f6ba-5872-4ce8-9ea2-92c22c008d6e on hv-cinder-81689 Jan 28 01:09:27.615084 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-f14ce585-fa2b-46b5-8ab4-0e38acd605c0 req-c03fe1cb-aee0-494f-8fe8-54db6a9d45bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161120 Jan 28 01:09:27.616177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 579/1119] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:09:28.608028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5f30888c-ed30-4efd-91de-bdb149c70584 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:28.608593 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5f30888c-ed30-4efd-91de-bdb149c70584 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:28.616170 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f30888c-ed30-4efd-91de-bdb149c70584 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:28.616661 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f30888c-ed30-4efd-91de-bdb149c70584 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:28.617538 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f30888c-ed30-4efd-91de-bdb149c70584 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:28.617986 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5f30888c-ed30-4efd-91de-bdb149c70584 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:28.764417 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-435ded61-c4c4-4c75-bce2-ba7c6eadb52e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f834909-78b2-4e67-abd1-257211a3888c"}} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:28.765549 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-435ded61-c4c4-4c75-bce2-ba7c6eadb52e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:28.771617 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-435ded61-c4c4-4c75-bce2-ba7c6eadb52e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:28.772070 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-435ded61-c4c4-4c75-bce2-ba7c6eadb52e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:28.772860 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-435ded61-c4c4-4c75-bce2-ba7c6eadb52e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:28.773297 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-435ded61-c4c4-4c75-bce2-ba7c6eadb52e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:28.882725 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5f30888c-ed30-4efd-91de-bdb149c70584 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:28.890132 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5f30888c-ed30-4efd-91de-bdb149c70584 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.286086 Jan 28 01:09:28.890779 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 541/1120] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:28 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:29.028691 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-435ded61-c4c4-4c75-bce2-ba7c6eadb52e tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268518 Jan 28 01:09:29.029311 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 580/1121] 10.222.0.78 () {60 vars in 1322 bytes} [Fri Jan 28 01:09:28 2022] POST /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:09:29.908859 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-a0047c8a-f718-4c49-8d77-5cd32d0c8f38 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:29.909387 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-a0047c8a-f718-4c49-8d77-5cd32d0c8f38 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:29.916122 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a0047c8a-f718-4c49-8d77-5cd32d0c8f38 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:29.916578 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a0047c8a-f718-4c49-8d77-5cd32d0c8f38 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:29.917373 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a0047c8a-f718-4c49-8d77-5cd32d0c8f38 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:29.917815 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-a0047c8a-f718-4c49-8d77-5cd32d0c8f38 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:30.049332 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-a0047c8a-f718-4c49-8d77-5cd32d0c8f38 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:30.056781 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-a0047c8a-f718-4c49-8d77-5cd32d0c8f38 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.152628 Jan 28 01:09:30.057356 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 542/1122] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:29 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:31.074773 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-94edd0c3-43f1-44a8-98ea-ad44269675f6 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:31.075563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-94edd0c3-43f1-44a8-98ea-ad44269675f6 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:31.082332 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-94edd0c3-43f1-44a8-98ea-ad44269675f6 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:31.082795 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-94edd0c3-43f1-44a8-98ea-ad44269675f6 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:31.083609 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-94edd0c3-43f1-44a8-98ea-ad44269675f6 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:31.084051 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-94edd0c3-43f1-44a8-98ea-ad44269675f6 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:31.212869 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-94edd0c3-43f1-44a8-98ea-ad44269675f6 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:31.222064 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-94edd0c3-43f1-44a8-98ea-ad44269675f6 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.151563 Jan 28 01:09:31.222847 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 581/1123] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:31 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:32.240878 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-435000a4-9eff-4806-b3e4-682b438c3954 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:32.241497 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-435000a4-9eff-4806-b3e4-682b438c3954 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:32.247825 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-435000a4-9eff-4806-b3e4-682b438c3954 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:32.248279 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-435000a4-9eff-4806-b3e4-682b438c3954 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:32.249069 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-435000a4-9eff-4806-b3e4-682b438c3954 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:32.249508 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-435000a4-9eff-4806-b3e4-682b438c3954 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:32.379967 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-435000a4-9eff-4806-b3e4-682b438c3954 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:32.387596 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-435000a4-9eff-4806-b3e4-682b438c3954 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.150298 Jan 28 01:09:32.388612 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 543/1124] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:32 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:33.404964 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-66246b0a-a28f-4afb-9e69-d7acecfb2bba tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:33.405578 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-66246b0a-a28f-4afb-9e69-d7acecfb2bba tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:33.413059 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-66246b0a-a28f-4afb-9e69-d7acecfb2bba tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:33.413514 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-66246b0a-a28f-4afb-9e69-d7acecfb2bba tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:33.414313 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-66246b0a-a28f-4afb-9e69-d7acecfb2bba tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:33.414754 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-66246b0a-a28f-4afb-9e69-d7acecfb2bba tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:33.551534 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-66246b0a-a28f-4afb-9e69-d7acecfb2bba tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:33.563840 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-66246b0a-a28f-4afb-9e69-d7acecfb2bba tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.162276 Jan 28 01:09:33.565380 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 582/1125] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:33 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:34.582124 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-dada57f4-5b6b-4913-8c79-174f587cc41d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:34.582698 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-dada57f4-5b6b-4913-8c79-174f587cc41d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:34.589259 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dada57f4-5b6b-4913-8c79-174f587cc41d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:34.589710 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dada57f4-5b6b-4913-8c79-174f587cc41d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:34.590495 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dada57f4-5b6b-4913-8c79-174f587cc41d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:34.590961 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-dada57f4-5b6b-4913-8c79-174f587cc41d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:34.721108 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-dada57f4-5b6b-4913-8c79-174f587cc41d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:34.728402 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-dada57f4-5b6b-4913-8c79-174f587cc41d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.150623 Jan 28 01:09:34.728969 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 544/1126] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:34 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:35.745139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-19c56796-b61b-43dc-9a32-0045e66e9e6a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:35.745747 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-19c56796-b61b-43dc-9a32-0045e66e9e6a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:35.752807 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-19c56796-b61b-43dc-9a32-0045e66e9e6a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:35.753257 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-19c56796-b61b-43dc-9a32-0045e66e9e6a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:35.754037 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-19c56796-b61b-43dc-9a32-0045e66e9e6a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:35.754475 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-19c56796-b61b-43dc-9a32-0045e66e9e6a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:35.895289 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-19c56796-b61b-43dc-9a32-0045e66e9e6a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:35.903737 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-19c56796-b61b-43dc-9a32-0045e66e9e6a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.162250 Jan 28 01:09:35.904327 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 583/1127] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:35 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:36.488937 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-3d984724-777c-4ab8-8f3f-7880ec9746c8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:36.489914 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-3d984724-777c-4ab8-8f3f-7880ec9746c8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:36.496236 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3d984724-777c-4ab8-8f3f-7880ec9746c8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:36.496688 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3d984724-777c-4ab8-8f3f-7880ec9746c8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:36.497474 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3d984724-777c-4ab8-8f3f-7880ec9746c8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:36.497913 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-3d984724-777c-4ab8-8f3f-7880ec9746c8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:36.527610 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-3d984724-777c-4ab8-8f3f-7880ec9746c8 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042389 Jan 28 01:09:36.528235 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 545/1128] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:09:36 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:36.814717 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-67828944-e93b-44ed-9639-7d630b79950f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:36.815351 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-67828944-e93b-44ed-9639-7d630b79950f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:36.821609 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-67828944-e93b-44ed-9639-7d630b79950f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:36.822058 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-67828944-e93b-44ed-9639-7d630b79950f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:36.822840 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-67828944-e93b-44ed-9639-7d630b79950f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:36.823301 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-67828944-e93b-44ed-9639-7d630b79950f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:36.852463 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-67828944-e93b-44ed-9639-7d630b79950f tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/0eb6d9f7-00cf-4435-9631-677b4617a8c1" status: 200 len: 194 microversion: 2.1 time: 0.041471 Jan 28 01:09:36.853066 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 584/1129] 10.222.0.78 () {58 vars in 1412 bytes} [Fri Jan 28 01:09:36 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/0eb6d9f7-00cf-4435-9631-677b4617a8c1 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:36.863490 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2e3b2c13-849a-4d23-889a-71fff7048499 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:36.863995 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2e3b2c13-849a-4d23-889a-71fff7048499 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:36.869963 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e3b2c13-849a-4d23-889a-71fff7048499 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:36.870438 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e3b2c13-849a-4d23-889a-71fff7048499 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:36.871239 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e3b2c13-849a-4d23-889a-71fff7048499 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:36.871689 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2e3b2c13-849a-4d23-889a-71fff7048499 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:36.921352 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ecd4ea73-5514-42c4-b267-700dec5ef36b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:36.922067 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ecd4ea73-5514-42c4-b267-700dec5ef36b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:36.928485 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ecd4ea73-5514-42c4-b267-700dec5ef36b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:36.928942 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ecd4ea73-5514-42c4-b267-700dec5ef36b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:36.930233 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ecd4ea73-5514-42c4-b267-700dec5ef36b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:36.930233 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ecd4ea73-5514-42c4-b267-700dec5ef36b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:36.950426 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.objects.instance [None req-2e3b2c13-849a-4d23-889a-71fff7048499 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lazy-loading 'services' on Instance uuid 776434ce-376a-4046-a629-90827f0d7754 {{(pid=116253) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:09:37.021971 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2e3b2c13-849a-4d23-889a-71fff7048499 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "DELETE /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/0eb6d9f7-00cf-4435-9631-677b4617a8c1" status: 202 len: 0 microversion: 2.1 time: 0.162786 Jan 28 01:09:37.023145 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 546/1130] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:09:36 2022] DELETE /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/0eb6d9f7-00cf-4435-9631-677b4617a8c1 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:09:37.077979 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ecd4ea73-5514-42c4-b267-700dec5ef36b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:37.085767 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ecd4ea73-5514-42c4-b267-700dec5ef36b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.168009 Jan 28 01:09:37.086405 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 585/1131] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:36 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:09:38.106004 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-044882f5-f7b9-4e29-bb01-77a00d7342fe tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:38.106581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-044882f5-f7b9-4e29-bb01-77a00d7342fe tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:38.113877 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-044882f5-f7b9-4e29-bb01-77a00d7342fe tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:38.114543 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-044882f5-f7b9-4e29-bb01-77a00d7342fe tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:38.115563 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-044882f5-f7b9-4e29-bb01-77a00d7342fe tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:38.115998 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-044882f5-f7b9-4e29-bb01-77a00d7342fe tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:38.152297 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-91f182cc-948e-4b73-b0ad-6dc97bb962a1 req-cf21cf86-c0fc-41fe-ae60-8b0b932d4f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de49f6ba-5872-4ce8-9ea2-92c22c008d6e", "name": "network-vif-plugged", "status": "completed", "tag": "c020ebfa-33a0-409c-b821-abfa02de16d9"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:38.153917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:09:38.153917 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:09:38.161882 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-91f182cc-948e-4b73-b0ad-6dc97bb962a1 req-cf21cf86-c0fc-41fe-ae60-8b0b932d4f6e service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:38.162418 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-91f182cc-948e-4b73-b0ad-6dc97bb962a1 req-cf21cf86-c0fc-41fe-ae60-8b0b932d4f6e service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:38.174555 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-91f182cc-948e-4b73-b0ad-6dc97bb962a1 req-cf21cf86-c0fc-41fe-ae60-8b0b932d4f6e service nova] Creating event network-vif-plugged:c020ebfa-33a0-409c-b821-abfa02de16d9 for instance de49f6ba-5872-4ce8-9ea2-92c22c008d6e on hv-cinder-81689 Jan 28 01:09:38.180113 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-91f182cc-948e-4b73-b0ad-6dc97bb962a1 req-cf21cf86-c0fc-41fe-ae60-8b0b932d4f6e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110753 Jan 28 01:09:38.180832 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 547/1132] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:38.260328 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-044882f5-f7b9-4e29-bb01-77a00d7342fe tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:38.268286 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-044882f5-f7b9-4e29-bb01-77a00d7342fe tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.166067 Jan 28 01:09:38.268897 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 586/1133] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:38 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:09:39.195381 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-b192be65-b95b-4215-b06d-61f3d3b21e97 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:39.195969 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-b192be65-b95b-4215-b06d-61f3d3b21e97 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:39.202415 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b192be65-b95b-4215-b06d-61f3d3b21e97 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:39.203030 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b192be65-b95b-4215-b06d-61f3d3b21e97 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:39.203822 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b192be65-b95b-4215-b06d-61f3d3b21e97 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:39.204261 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-b192be65-b95b-4215-b06d-61f3d3b21e97 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:39.232548 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-b192be65-b95b-4215-b06d-61f3d3b21e97 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/8f834909-78b2-4e67-abd1-257211a3888c" status: 200 len: 194 microversion: 2.1 time: 0.041392 Jan 28 01:09:39.233131 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 548/1134] 10.222.0.78 () {58 vars in 1412 bytes} [Fri Jan 28 01:09:39 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/8f834909-78b2-4e67-abd1-257211a3888c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:39.243394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8f154465-f71f-4cae-a049-b096f00629fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:39.243901 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8f154465-f71f-4cae-a049-b096f00629fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:39.250262 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8f154465-f71f-4cae-a049-b096f00629fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:39.250739 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8f154465-f71f-4cae-a049-b096f00629fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:39.251579 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8f154465-f71f-4cae-a049-b096f00629fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:39.252055 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8f154465-f71f-4cae-a049-b096f00629fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:39.287254 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-5303f7e7-b88a-41ff-b8f4-307295e09fd3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:39.287880 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-5303f7e7-b88a-41ff-b8f4-307295e09fd3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:39.294242 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5303f7e7-b88a-41ff-b8f4-307295e09fd3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:39.294692 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5303f7e7-b88a-41ff-b8f4-307295e09fd3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:39.295765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5303f7e7-b88a-41ff-b8f4-307295e09fd3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:39.296211 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-5303f7e7-b88a-41ff-b8f4-307295e09fd3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:39.335128 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.objects.instance [None req-8f154465-f71f-4cae-a049-b096f00629fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lazy-loading 'services' on Instance uuid 776434ce-376a-4046-a629-90827f0d7754 {{(pid=116254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:09:39.403931 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8f154465-f71f-4cae-a049-b096f00629fa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "DELETE /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/8f834909-78b2-4e67-abd1-257211a3888c" status: 202 len: 0 microversion: 2.1 time: 0.164104 Jan 28 01:09:39.404612 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 587/1135] 10.222.0.78 () {58 vars in 1415 bytes} [Fri Jan 28 01:09:39 2022] DELETE /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments/8f834909-78b2-4e67-abd1-257211a3888c => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:09:39.447217 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-5303f7e7-b88a-41ff-b8f4-307295e09fd3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:39.456326 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-5303f7e7-b88a-41ff-b8f4-307295e09fd3 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1267 microversion: 2.1 time: 0.173594 Jan 28 01:09:39.465813 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 549/1136] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:39 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:09:40.474362 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-0ac1720e-d3c7-40a6-95ee-9d40e8bd2407 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:40.475091 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-0ac1720e-d3c7-40a6-95ee-9d40e8bd2407 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:40.482788 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0ac1720e-d3c7-40a6-95ee-9d40e8bd2407 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:40.483512 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0ac1720e-d3c7-40a6-95ee-9d40e8bd2407 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:40.484314 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0ac1720e-d3c7-40a6-95ee-9d40e8bd2407 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:40.484746 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-0ac1720e-d3c7-40a6-95ee-9d40e8bd2407 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:40.623526 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-0ac1720e-d3c7-40a6-95ee-9d40e8bd2407 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:40.631436 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-0ac1720e-d3c7-40a6-95ee-9d40e8bd2407 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1454 microversion: 2.1 time: 0.162529 Jan 28 01:09:40.632011 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 588/1137] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:40 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:40.648935 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-fd2b0ea5-2924-44d8-afa8-044ccdfca372 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:40.649554 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-fd2b0ea5-2924-44d8-afa8-044ccdfca372 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:40.656025 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fd2b0ea5-2924-44d8-afa8-044ccdfca372 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:40.656511 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fd2b0ea5-2924-44d8-afa8-044ccdfca372 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:40.657356 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fd2b0ea5-2924-44d8-afa8-044ccdfca372 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:40.658081 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-fd2b0ea5-2924-44d8-afa8-044ccdfca372 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:40.791938 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-fd2b0ea5-2924-44d8-afa8-044ccdfca372 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:40.799845 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-fd2b0ea5-2924-44d8-afa8-044ccdfca372 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1454 microversion: 2.1 time: 0.154721 Jan 28 01:09:40.800404 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 550/1138] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:40 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:41.614833 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-b4c053d0-4d6e-40a8-905d-eced3a702dec tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:41.615991 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-b4c053d0-4d6e-40a8-905d-eced3a702dec tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:41.623131 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b4c053d0-4d6e-40a8-905d-eced3a702dec tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:41.623591 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b4c053d0-4d6e-40a8-905d-eced3a702dec tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:41.624579 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b4c053d0-4d6e-40a8-905d-eced3a702dec tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:41.625032 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-b4c053d0-4d6e-40a8-905d-eced3a702dec tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:41.658427 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-b4c053d0-4d6e-40a8-905d-eced3a702dec tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047312 Jan 28 01:09:41.659022 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 589/1139] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:09:41 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:09:41.764793 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-144dd83a-d068-4870-9d47-3df17777dea1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:41.765725 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-144dd83a-d068-4870-9d47-3df17777dea1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:41.772192 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-144dd83a-d068-4870-9d47-3df17777dea1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:41.772655 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-144dd83a-d068-4870-9d47-3df17777dea1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:41.773560 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-144dd83a-d068-4870-9d47-3df17777dea1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:41.774009 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-144dd83a-d068-4870-9d47-3df17777dea1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:41.805350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-144dd83a-d068-4870-9d47-3df17777dea1 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044214 Jan 28 01:09:41.805817 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 551/1140] 10.222.0.78 () {58 vars in 1301 bytes} [Fri Jan 28 01:09:41 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:09:41.865380 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1f70c379-b643-44fc-b57d-b2afc60d3414 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:41.865887 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1f70c379-b643-44fc-b57d-b2afc60d3414 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:41.872072 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f70c379-b643-44fc-b57d-b2afc60d3414 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:41.872604 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f70c379-b643-44fc-b57d-b2afc60d3414 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:41.873534 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f70c379-b643-44fc-b57d-b2afc60d3414 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:41.874011 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-1f70c379-b643-44fc-b57d-b2afc60d3414 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:41.900360 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-1f70c379-b643-44fc-b57d-b2afc60d3414 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Going to try to terminate instance {{(pid=116254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:09:41.983717 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1f70c379-b643-44fc-b57d-b2afc60d3414 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "DELETE /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 204 len: 0 microversion: 2.1 time: 0.122236 Jan 28 01:09:41.985240 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 590/1141] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:09:41 2022] DELETE /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:09:41.993978 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-854fb1ee-0a87-4fd5-bca0-f40a7f358811 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:41.994985 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-854fb1ee-0a87-4fd5-bca0-f40a7f358811 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:42.002216 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-854fb1ee-0a87-4fd5-bca0-f40a7f358811 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:42.002667 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-854fb1ee-0a87-4fd5-bca0-f40a7f358811 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:42.003528 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-854fb1ee-0a87-4fd5-bca0-f40a7f358811 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:42.003968 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-854fb1ee-0a87-4fd5-bca0-f40a7f358811 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:42.140682 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-854fb1ee-0a87-4fd5-bca0-f40a7f358811 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:42.149452 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-854fb1ee-0a87-4fd5-bca0-f40a7f358811 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1672 microversion: 2.1 time: 0.159761 Jan 28 01:09:42.150120 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 552/1142] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:41 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:42.446717 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [req-30460239-fa5a-410a-b1fd-00ad93d5dcc2 req-dd9c8e17-c303-4c91-8f5c-42e07d0bd6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de49f6ba-5872-4ce8-9ea2-92c22c008d6e", "tag": "c020ebfa-33a0-409c-b821-abfa02de16d9"}]} {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:42.449030 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:09:42.449030 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: warnings.warn(msg) Jan 28 01:09:42.456868 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-30460239-fa5a-410a-b1fd-00ad93d5dcc2 req-dd9c8e17-c303-4c91-8f5c-42e07d0bd6f7 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:42.457462 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [req-30460239-fa5a-410a-b1fd-00ad93d5dcc2 req-dd9c8e17-c303-4c91-8f5c-42e07d0bd6f7 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:42.469479 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.compute.server_external_events [req-30460239-fa5a-410a-b1fd-00ad93d5dcc2 req-dd9c8e17-c303-4c91-8f5c-42e07d0bd6f7 service nova] Creating event network-changed:c020ebfa-33a0-409c-b821-abfa02de16d9 for instance de49f6ba-5872-4ce8-9ea2-92c22c008d6e on hv-cinder-81689 Jan 28 01:09:42.474659 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [req-30460239-fa5a-410a-b1fd-00ad93d5dcc2 req-dd9c8e17-c303-4c91-8f5c-42e07d0bd6f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032387 Jan 28 01:09:42.475368 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 591/1143] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:43.166622 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-097c0674-5cc6-4c21-8a10-06d194f52afa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:43.167273 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-097c0674-5cc6-4c21-8a10-06d194f52afa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:43.174476 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-097c0674-5cc6-4c21-8a10-06d194f52afa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:43.175029 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-097c0674-5cc6-4c21-8a10-06d194f52afa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:43.175879 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-097c0674-5cc6-4c21-8a10-06d194f52afa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:43.176350 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-097c0674-5cc6-4c21-8a10-06d194f52afa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:43.312604 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-097c0674-5cc6-4c21-8a10-06d194f52afa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:43.321706 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-097c0674-5cc6-4c21-8a10-06d194f52afa tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1672 microversion: 2.1 time: 0.158461 Jan 28 01:09:43.322098 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 553/1144] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:43 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:09:44.340543 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-ea4257c1-3a56-4d86-aca0-1373cc934187 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:44.341198 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-ea4257c1-3a56-4d86-aca0-1373cc934187 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:44.348167 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ea4257c1-3a56-4d86-aca0-1373cc934187 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:44.348627 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ea4257c1-3a56-4d86-aca0-1373cc934187 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:44.349419 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ea4257c1-3a56-4d86-aca0-1373cc934187 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:44.349857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-ea4257c1-3a56-4d86-aca0-1373cc934187 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:44.490658 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-ea4257c1-3a56-4d86-aca0-1373cc934187 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213001750f3f475b82276d5743358ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad98bf7b3c546848923e916df460759', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:09:44.498126 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-ea4257c1-3a56-4d86-aca0-1373cc934187 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 200 len: 1672 microversion: 2.1 time: 0.162298 Jan 28 01:09:44.498735 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 592/1145] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:44 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:09:44.857162 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-f07b11b0-0569-4679-a9ae-4bbc959a67ec req-1c00cae0-b98c-441f-9359-7a8dfb928f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776434ce-376a-4046-a629-90827f0d7754", "name": "network-vif-deleted", "tag": "7d56a33f-b73a-4fad-8aa7-124e12773925"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:09:44.861424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:09:44.861424 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:09:44.869969 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-f07b11b0-0569-4679-a9ae-4bbc959a67ec req-1c00cae0-b98c-441f-9359-7a8dfb928f82 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:44.870528 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-f07b11b0-0569-4679-a9ae-4bbc959a67ec req-1c00cae0-b98c-441f-9359-7a8dfb928f82 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:44.884380 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-f07b11b0-0569-4679-a9ae-4bbc959a67ec req-1c00cae0-b98c-441f-9359-7a8dfb928f82 service nova] Creating event network-vif-deleted:7d56a33f-b73a-4fad-8aa7-124e12773925 for instance 776434ce-376a-4046-a629-90827f0d7754 on hv-cinder-81689 Jan 28 01:09:44.891409 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-f07b11b0-0569-4679-a9ae-4bbc959a67ec req-1c00cae0-b98c-441f-9359-7a8dfb928f82 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042473 Jan 28 01:09:44.892130 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 554/1146] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:09:45.516711 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-614cf117-500f-467e-981c-e2cebcb6d12c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:45.517851 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-614cf117-500f-467e-981c-e2cebcb6d12c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:45.525434 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-614cf117-500f-467e-981c-e2cebcb6d12c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:45.525893 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-614cf117-500f-467e-981c-e2cebcb6d12c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:45.526698 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-614cf117-500f-467e-981c-e2cebcb6d12c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:45.527168 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-614cf117-500f-467e-981c-e2cebcb6d12c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:45.542162 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-614cf117-500f-467e-981c-e2cebcb6d12c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] HTTP exception thrown: Instance 776434ce-376a-4046-a629-90827f0d7754 could not be found. Jan 28 01:09:45.542855 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-614cf117-500f-467e-981c-e2cebcb6d12c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Returning 404 to user: Instance 776434ce-376a-4046-a629-90827f0d7754 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:09:45.543722 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-614cf117-500f-467e-981c-e2cebcb6d12c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 404 len: 111 microversion: 2.1 time: 0.031521 Jan 28 01:09:45.544538 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 593/1147] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:45 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:09:45.554104 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-89004f53-5c69-4c05-b94b-d29df84e931c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '.version_select at 0x7f1a094d8c10>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:45.572743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-89004f53-5c69-4c05-b94b-d29df84e931c tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491038333" status: 202 len: 0 microversion: 2.1 time: 0.022688 Jan 28 01:09:45.573331 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 555/1148] 10.222.0.78 () {58 vars in 1217 bytes} [Fri Jan 28 01:09:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491038333 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:09:48.682835 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8c2bc56c-88ec-4b97-99e1-22752d7595ad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:48.683543 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-8c2bc56c-88ec-4b97-99e1-22752d7595ad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:48.689777 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8c2bc56c-88ec-4b97-99e1-22752d7595ad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:48.690231 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8c2bc56c-88ec-4b97-99e1-22752d7595ad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:48.691081 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8c2bc56c-88ec-4b97-99e1-22752d7595ad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:48.691522 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-8c2bc56c-88ec-4b97-99e1-22752d7595ad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:48.704495 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-8c2bc56c-88ec-4b97-99e1-22752d7595ad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] HTTP exception thrown: Instance 776434ce-376a-4046-a629-90827f0d7754 could not be found. Jan 28 01:09:48.705011 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-8c2bc56c-88ec-4b97-99e1-22752d7595ad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Returning 404 to user: Instance 776434ce-376a-4046-a629-90827f0d7754 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:09:48.705826 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-8c2bc56c-88ec-4b97-99e1-22752d7595ad tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "DELETE /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 404 len: 111 microversion: 2.1 time: 0.026723 Jan 28 01:09:48.706355 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 594/1149] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:09:48 2022] DELETE /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:09:48.715084 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4e6ff0ba-2d71-4028-b182-8d5419166fcb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:48.715909 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4e6ff0ba-2d71-4028-b182-8d5419166fcb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 776434ce-376a-4046-a629-90827f0d7754] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:48.722569 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e6ff0ba-2d71-4028-b182-8d5419166fcb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:48.723061 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e6ff0ba-2d71-4028-b182-8d5419166fcb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:48.723856 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e6ff0ba-2d71-4028-b182-8d5419166fcb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:48.724306 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e6ff0ba-2d71-4028-b182-8d5419166fcb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:48.738225 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-4e6ff0ba-2d71-4028-b182-8d5419166fcb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] HTTP exception thrown: Instance 776434ce-376a-4046-a629-90827f0d7754 could not be found. Jan 28 01:09:48.738823 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4e6ff0ba-2d71-4028-b182-8d5419166fcb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Returning 404 to user: Instance 776434ce-376a-4046-a629-90827f0d7754 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:09:48.739681 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4e6ff0ba-2d71-4028-b182-8d5419166fcb tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754" status: 404 len: 111 microversion: 2.1 time: 0.029111 Jan 28 01:09:48.740216 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 556/1150] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:48 2022] GET /compute/v2.1/servers/776434ce-376a-4046-a629-90827f0d7754 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:09:49.867570 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-da8a8781-16eb-4234-bdeb-c541e1da3819 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:49.868060 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-da8a8781-16eb-4234-bdeb-c541e1da3819 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:49.874554 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-da8a8781-16eb-4234-bdeb-c541e1da3819 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:49.875036 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-da8a8781-16eb-4234-bdeb-c541e1da3819 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:49.875827 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-da8a8781-16eb-4234-bdeb-c541e1da3819 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:49.876268 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-da8a8781-16eb-4234-bdeb-c541e1da3819 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:49.891857 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-da8a8781-16eb-4234-bdeb-c541e1da3819 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] HTTP exception thrown: Instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 could not be found. Jan 28 01:09:49.892938 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-da8a8781-16eb-4234-bdeb-c541e1da3819 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Returning 404 to user: Instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:09:49.893771 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-da8a8781-16eb-4234-bdeb-c541e1da3819 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 404 len: 111 microversion: 2.1 time: 0.029836 Jan 28 01:09:49.894303 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 595/1151] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:09:49 2022] DELETE /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:09:49.902256 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4ed33245-4dcd-41f7-9649-d7421e8b4789 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:09:49.902878 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4ed33245-4dcd-41f7-9649-d7421e8b4789 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] [instance: 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:09:49.910058 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4ed33245-4dcd-41f7-9649-d7421e8b4789 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:49.910512 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4ed33245-4dcd-41f7-9649-d7421e8b4789 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:49.911343 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4ed33245-4dcd-41f7-9649-d7421e8b4789 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:09:49.911788 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4ed33245-4dcd-41f7-9649-d7421e8b4789 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:09:49.925031 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-4ed33245-4dcd-41f7-9649-d7421e8b4789 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] HTTP exception thrown: Instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 could not be found. Jan 28 01:09:49.925629 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4ed33245-4dcd-41f7-9649-d7421e8b4789 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] Returning 404 to user: Instance 2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:09:49.926507 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4ed33245-4dcd-41f7-9649-d7421e8b4789 tempest-AttachVolumeTestJSON-1700982804 tempest-AttachVolumeTestJSON-1700982804-project] 10.222.0.78 "GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1" status: 404 len: 111 microversion: 2.1 time: 0.028075 Jan 28 01:09:49.927128 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 557/1152] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:09:49 2022] GET /compute/v2.1/servers/2aea1fd8-d209-41a0-bcf4-0b5351e9f3e1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:11:07.412039 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:11:07.412649 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: Fri Jan 28 01:11:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:11:27.406623 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-75a59bef-f02c-48c4-bc3d-e69855abc502 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:27.407327 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-75a59bef-f02c-48c4-bc3d-e69855abc502 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:27.409758 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-258d5d0d-6947-4fe7-98fa-c73104328dc5 req-bd29cae3-a657-4bb0-8ac4-e470b934d4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de49f6ba-5872-4ce8-9ea2-92c22c008d6e", "tag": "c020ebfa-33a0-409c-b821-abfa02de16d9"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:11:27.411655 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:11:27.411655 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:11:27.413704 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-75a59bef-f02c-48c4-bc3d-e69855abc502 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:27.414182 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-75a59bef-f02c-48c4-bc3d-e69855abc502 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:27.415200 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-75a59bef-f02c-48c4-bc3d-e69855abc502 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:27.415650 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-75a59bef-f02c-48c4-bc3d-e69855abc502 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:27.419246 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-258d5d0d-6947-4fe7-98fa-c73104328dc5 req-bd29cae3-a657-4bb0-8ac4-e470b934d4ee service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:27.419774 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-258d5d0d-6947-4fe7-98fa-c73104328dc5 req-bd29cae3-a657-4bb0-8ac4-e470b934d4ee service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:27.431669 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-258d5d0d-6947-4fe7-98fa-c73104328dc5 req-bd29cae3-a657-4bb0-8ac4-e470b934d4ee service nova] Creating event network-changed:c020ebfa-33a0-409c-b821-abfa02de16d9 for instance de49f6ba-5872-4ce8-9ea2-92c22c008d6e on hv-cinder-81689 Jan 28 01:11:27.437730 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-258d5d0d-6947-4fe7-98fa-c73104328dc5 req-bd29cae3-a657-4bb0-8ac4-e470b934d4ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033941 Jan 28 01:11:27.438624 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 558/1153] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:11:27.446480 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-75a59bef-f02c-48c4-bc3d-e69855abc502 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Going to try to terminate instance {{(pid=116254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:11:27.525740 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-75a59bef-f02c-48c4-bc3d-e69855abc502 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "DELETE /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 204 len: 0 microversion: 2.1 time: 0.123709 Jan 28 01:11:27.530333 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 596/1154] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:11:27 2022] DELETE /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:11:27.536187 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-4e7563a1-fb69-408d-aea6-37548abe221d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:27.536914 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-4e7563a1-fb69-408d-aea6-37548abe221d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:27.544130 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e7563a1-fb69-408d-aea6-37548abe221d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:27.544614 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e7563a1-fb69-408d-aea6-37548abe221d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:27.545399 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e7563a1-fb69-408d-aea6-37548abe221d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:27.545837 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-4e7563a1-fb69-408d-aea6-37548abe221d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:27.783012 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-4e7563a1-fb69-408d-aea6-37548abe221d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:11:27.790827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-4e7563a1-fb69-408d-aea6-37548abe221d tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1579 microversion: 2.1 time: 0.259148 Jan 28 01:11:27.791626 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 559/1155] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:11:27 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1579 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:11:28.809077 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d3c6baca-c2b4-401b-b003-8d70ef7a8dc4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:28.809770 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d3c6baca-c2b4-401b-b003-8d70ef7a8dc4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:28.816202 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d3c6baca-c2b4-401b-b003-8d70ef7a8dc4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:28.816646 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d3c6baca-c2b4-401b-b003-8d70ef7a8dc4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:28.817415 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d3c6baca-c2b4-401b-b003-8d70ef7a8dc4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:28.817846 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d3c6baca-c2b4-401b-b003-8d70ef7a8dc4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:28.947839 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d3c6baca-c2b4-401b-b003-8d70ef7a8dc4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:11:28.955177 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d3c6baca-c2b4-401b-b003-8d70ef7a8dc4 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1460 microversion: 2.1 time: 0.150050 Jan 28 01:11:28.955736 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 597/1156] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:11:28 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1460 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:11:29.778727 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-77620397-0386-4886-8c75-054879348247 req-23e67030-2ec8-4eef-b76c-f79d033dd278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de49f6ba-5872-4ce8-9ea2-92c22c008d6e", "name": "network-vif-deleted", "tag": "c020ebfa-33a0-409c-b821-abfa02de16d9"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:11:29.780282 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:11:29.780282 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:11:29.788185 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-77620397-0386-4886-8c75-054879348247 req-23e67030-2ec8-4eef-b76c-f79d033dd278 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:29.788636 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-77620397-0386-4886-8c75-054879348247 req-23e67030-2ec8-4eef-b76c-f79d033dd278 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:29.800013 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-77620397-0386-4886-8c75-054879348247 req-23e67030-2ec8-4eef-b76c-f79d033dd278 service nova] Creating event network-vif-deleted:c020ebfa-33a0-409c-b821-abfa02de16d9 for instance de49f6ba-5872-4ce8-9ea2-92c22c008d6e on hv-cinder-81689 Jan 28 01:11:29.804766 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-77620397-0386-4886-8c75-054879348247 req-23e67030-2ec8-4eef-b76c-f79d033dd278 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029681 Jan 28 01:11:29.805689 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 560/1157] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:11:29.972086 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-887b6363-b9e0-4211-83a6-d80f94366bbf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:29.972714 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-887b6363-b9e0-4211-83a6-d80f94366bbf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:29.979303 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-887b6363-b9e0-4211-83a6-d80f94366bbf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:29.979801 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-887b6363-b9e0-4211-83a6-d80f94366bbf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:29.980535 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-887b6363-b9e0-4211-83a6-d80f94366bbf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:29.980962 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-887b6363-b9e0-4211-83a6-d80f94366bbf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:30.040395 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-887b6363-b9e0-4211-83a6-d80f94366bbf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:11:30.048518 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-887b6363-b9e0-4211-83a6-d80f94366bbf tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 200 len: 1226 microversion: 2.1 time: 0.080096 Jan 28 01:11:30.049103 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 598/1158] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:11:29 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:11:31.066370 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6f202b6d-e4e5-4306-9979-1a59e46a3c99 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:31.067088 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-6f202b6d-e4e5-4306-9979-1a59e46a3c99 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: de49f6ba-5872-4ce8-9ea2-92c22c008d6e] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:31.073346 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6f202b6d-e4e5-4306-9979-1a59e46a3c99 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:31.073791 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6f202b6d-e4e5-4306-9979-1a59e46a3c99 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:31.074575 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6f202b6d-e4e5-4306-9979-1a59e46a3c99 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:31.075079 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-6f202b6d-e4e5-4306-9979-1a59e46a3c99 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:31.088823 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-6f202b6d-e4e5-4306-9979-1a59e46a3c99 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] HTTP exception thrown: Instance de49f6ba-5872-4ce8-9ea2-92c22c008d6e could not be found. Jan 28 01:11:31.089414 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-6f202b6d-e4e5-4306-9979-1a59e46a3c99 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Returning 404 to user: Instance de49f6ba-5872-4ce8-9ea2-92c22c008d6e could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:11:31.090249 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-6f202b6d-e4e5-4306-9979-1a59e46a3c99 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e" status: 404 len: 111 microversion: 2.1 time: 0.028374 Jan 28 01:11:31.090818 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 561/1159] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:11:31 2022] GET /compute/v2.1/servers/de49f6ba-5872-4ce8-9ea2-92c22c008d6e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:11:34.132743 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-fcf4c6db-8377-4e54-a04e-1e6061d2eec2 req-0ce1cd08-beb8-493b-8063-2baf482a6727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3531392-d8a5-4709-a9d7-fda2d5d83dba", "tag": "79623ca0-bf5f-4222-a661-53089e18c3c2"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:11:34.134258 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:11:34.134258 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:11:34.140099 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-a190209a-aa82-415a-b36b-97611b82688a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:34.141127 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a190209a-aa82-415a-b36b-97611b82688a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:34.142028 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-fcf4c6db-8377-4e54-a04e-1e6061d2eec2 req-0ce1cd08-beb8-493b-8063-2baf482a6727 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:34.142539 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-fcf4c6db-8377-4e54-a04e-1e6061d2eec2 req-0ce1cd08-beb8-493b-8063-2baf482a6727 service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:34.147650 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a190209a-aa82-415a-b36b-97611b82688a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:34.148106 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a190209a-aa82-415a-b36b-97611b82688a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:34.148895 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a190209a-aa82-415a-b36b-97611b82688a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:34.149519 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-a190209a-aa82-415a-b36b-97611b82688a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:34.154768 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-fcf4c6db-8377-4e54-a04e-1e6061d2eec2 req-0ce1cd08-beb8-493b-8063-2baf482a6727 service nova] Creating event network-changed:79623ca0-bf5f-4222-a661-53089e18c3c2 for instance b3531392-d8a5-4709-a9d7-fda2d5d83dba on hv-cinder-81689 Jan 28 01:11:34.160004 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-fcf4c6db-8377-4e54-a04e-1e6061d2eec2 req-0ce1cd08-beb8-493b-8063-2baf482a6727 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030754 Jan 28 01:11:34.160618 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 562/1160] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:11:34.177270 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-a190209a-aa82-415a-b36b-97611b82688a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Going to try to terminate instance {{(pid=116254) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:11:34.261348 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-a190209a-aa82-415a-b36b-97611b82688a tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 204 len: 0 microversion: 2.1 time: 0.134714 Jan 28 01:11:34.262243 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 599/1161] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:11:34 2022] DELETE /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:11:34.271069 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-763d66e9-89a0-4075-ad30-300225503d7c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:34.271790 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-763d66e9-89a0-4075-ad30-300225503d7c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:34.279864 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-89a0-4075-ad30-300225503d7c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:34.280324 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-89a0-4075-ad30-300225503d7c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:34.281130 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-89a0-4075-ad30-300225503d7c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:34.281765 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-763d66e9-89a0-4075-ad30-300225503d7c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:34.517348 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.policy [None req-763d66e9-89a0-4075-ad30-300225503d7c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116253) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:11:34.525084 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-763d66e9-89a0-4075-ad30-300225503d7c tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1578 microversion: 2.1 time: 0.258319 Jan 28 01:11:34.525671 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 563/1162] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:11:34 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1578 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:11:35.543421 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-d56ade21-7f3d-41f6-befa-56eddef3b554 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:35.544129 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-d56ade21-7f3d-41f6-befa-56eddef3b554 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:35.550374 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d56ade21-7f3d-41f6-befa-56eddef3b554 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:35.550833 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d56ade21-7f3d-41f6-befa-56eddef3b554 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:35.551647 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d56ade21-7f3d-41f6-befa-56eddef3b554 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:35.552088 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-d56ade21-7f3d-41f6-befa-56eddef3b554 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:35.686793 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-d56ade21-7f3d-41f6-befa-56eddef3b554 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:11:35.694153 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-d56ade21-7f3d-41f6-befa-56eddef3b554 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1459 microversion: 2.1 time: 0.154766 Jan 28 01:11:35.694790 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 600/1163] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:11:35 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:11:36.663162 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [req-05d8b516-9cfd-437e-928b-6b38b06d7351 req-3dda00e8-fa85-4889-aa05-80cb8229457f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3531392-d8a5-4709-a9d7-fda2d5d83dba", "name": "network-vif-deleted", "tag": "79623ca0-bf5f-4222-a661-53089e18c3c2"}]} {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:11:36.664879 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:11:36.664879 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: warnings.warn(msg) Jan 28 01:11:36.672580 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-05d8b516-9cfd-437e-928b-6b38b06d7351 req-3dda00e8-fa85-4889-aa05-80cb8229457f service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:36.673027 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [req-05d8b516-9cfd-437e-928b-6b38b06d7351 req-3dda00e8-fa85-4889-aa05-80cb8229457f service nova] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:36.685045 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.compute.server_external_events [req-05d8b516-9cfd-437e-928b-6b38b06d7351 req-3dda00e8-fa85-4889-aa05-80cb8229457f service nova] Creating event network-vif-deleted:79623ca0-bf5f-4222-a661-53089e18c3c2 for instance b3531392-d8a5-4709-a9d7-fda2d5d83dba on hv-cinder-81689 Jan 28 01:11:36.689927 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [req-05d8b516-9cfd-437e-928b-6b38b06d7351 req-3dda00e8-fa85-4889-aa05-80cb8229457f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030359 Jan 28 01:11:36.690799 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 564/1164] 10.222.0.78 () {64 vars in 1317 bytes} [Fri Jan 28 01:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:11:36.711848 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-5a9c91a1-4825-45cb-bac2-627087b95f0b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:36.712524 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-5a9c91a1-4825-45cb-bac2-627087b95f0b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:36.721135 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a9c91a1-4825-45cb-bac2-627087b95f0b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:36.721594 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a9c91a1-4825-45cb-bac2-627087b95f0b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:36.722394 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a9c91a1-4825-45cb-bac2-627087b95f0b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:36.722831 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-5a9c91a1-4825-45cb-bac2-627087b95f0b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:36.783560 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.policy [None req-5a9c91a1-4825-45cb-bac2-627087b95f0b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38bed71713534d0999a15ea8440717a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84aa61f3492a445c961e0e4b3682cfcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116254) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:11:36.791104 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-5a9c91a1-4825-45cb-bac2-627087b95f0b tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 200 len: 1225 microversion: 2.1 time: 0.082842 Jan 28 01:11:36.791666 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 601/1165] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:11:36 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:11:37.808460 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2f2cd9b1-e7af-4642-a14b-f8fc4f269db8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:37.809159 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-2f2cd9b1-e7af-4642-a14b-f8fc4f269db8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: b3531392-d8a5-4709-a9d7-fda2d5d83dba] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:37.816143 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f2cd9b1-e7af-4642-a14b-f8fc4f269db8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:37.816592 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f2cd9b1-e7af-4642-a14b-f8fc4f269db8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:37.817364 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f2cd9b1-e7af-4642-a14b-f8fc4f269db8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:37.817802 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-2f2cd9b1-e7af-4642-a14b-f8fc4f269db8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:37.832587 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-2f2cd9b1-e7af-4642-a14b-f8fc4f269db8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] HTTP exception thrown: Instance b3531392-d8a5-4709-a9d7-fda2d5d83dba could not be found. Jan 28 01:11:37.833180 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-2f2cd9b1-e7af-4642-a14b-f8fc4f269db8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Returning 404 to user: Instance b3531392-d8a5-4709-a9d7-fda2d5d83dba could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:11:37.834007 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-2f2cd9b1-e7af-4642-a14b-f8fc4f269db8 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba" status: 404 len: 111 microversion: 2.1 time: 0.029672 Jan 28 01:11:37.834548 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 565/1166] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:11:37 2022] GET /compute/v2.1/servers/b3531392-d8a5-4709-a9d7-fda2d5d83dba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:11:38.280390 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e4d86f40-2dff-45f6-8a3b-854384fa3920 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:38.280897 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.compute.api [None req-e4d86f40-2dff-45f6-8a3b-854384fa3920 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116254) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:38.287546 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e4d86f40-2dff-45f6-8a3b-854384fa3920 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:38.287997 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e4d86f40-2dff-45f6-8a3b-854384fa3920 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:38.288789 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e4d86f40-2dff-45f6-8a3b-854384fa3920 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:38.289234 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG oslo_concurrency.lockutils [None req-e4d86f40-2dff-45f6-8a3b-854384fa3920 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116254) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:38.302636 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.wsgi [None req-e4d86f40-2dff-45f6-8a3b-854384fa3920 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] HTTP exception thrown: Instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd could not be found. Jan 28 01:11:38.303260 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-e4d86f40-2dff-45f6-8a3b-854384fa3920 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Returning 404 to user: Instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd could not be found. {{(pid=116254) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:11:38.304139 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-e4d86f40-2dff-45f6-8a3b-854384fa3920 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "DELETE /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 404 len: 111 microversion: 2.1 time: 0.028028 Jan 28 01:11:38.304676 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 602/1167] 10.222.0.78 () {58 vars in 1238 bytes} [Fri Jan 28 01:11:38 2022] DELETE /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:11:38.312827 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-54053d49-38a6-478c-a7a5-d8e140ba4c19 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '>' {{(pid=116253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:38.313435 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.compute.api [None req-54053d49-38a6-478c-a7a5-d8e140ba4c19 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] [instance: 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd] Fetching instance by UUID {{(pid=116253) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:11:38.319206 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54053d49-38a6-478c-a7a5-d8e140ba4c19 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:38.319653 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54053d49-38a6-478c-a7a5-d8e140ba4c19 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:38.320421 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54053d49-38a6-478c-a7a5-d8e140ba4c19 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:11:38.320857 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG oslo_concurrency.lockutils [None req-54053d49-38a6-478c-a7a5-d8e140ba4c19 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Lock "b926b697-60d5-4462-a136-42dafa155e01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:11:38.334186 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.wsgi [None req-54053d49-38a6-478c-a7a5-d8e140ba4c19 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] HTTP exception thrown: Instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd could not be found. Jan 28 01:11:38.334872 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: DEBUG nova.api.openstack.wsgi [None req-54053d49-38a6-478c-a7a5-d8e140ba4c19 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Returning 404 to user: Instance 829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd could not be found. {{(pid=116253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:11:38.335697 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO nova.api.openstack.requestlog [None req-54053d49-38a6-478c-a7a5-d8e140ba4c19 tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd" status: 404 len: 111 microversion: 2.1 time: 0.026638 Jan 28 01:11:38.336228 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: [pid: 116253|app: 0|req: 566/1168] 10.222.0.78 () {58 vars in 1235 bytes} [Fri Jan 28 01:11:38 2022] GET /compute/v2.1/servers/829d8ceb-cc9b-4734-b5b3-ea72a8fbe5bd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:11:39.617482 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: DEBUG nova.api.openstack.wsgi [None req-1aa459ed-81ca-459c-8db7-ad5f26ac2a4e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] Calling method '.version_select at 0x7f1a0947e0d0>' {{(pid=116254) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:11:39.640498 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO nova.api.openstack.requestlog [None req-1aa459ed-81ca-459c-8db7-ad5f26ac2a4e tempest-TestVolumeBootPattern-620688659 tempest-TestVolumeBootPattern-620688659-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1017196631" status: 202 len: 0 microversion: 2.1 time: 0.026037 Jan 28 01:11:39.641250 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: [pid: 116254|app: 0|req: 603/1169] 10.222.0.78 () {58 vars in 1262 bytes} [Fri Jan 28 01:11:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1017196631 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:12:43.260729 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:12:43.261384 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: Fri Jan 28 01:12:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:12:53.195861 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:12:53.196684 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: Fri Jan 28 01:12:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:12:58.339289 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:12:58.339896 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: Fri Jan 28 01:12:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:14:27.419946 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:14:27.420772 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: Fri Jan 28 01:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:14:41.666477 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:14:41.667137 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: Fri Jan 28 01:14:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:14:54.126181 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:14:54.126793 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: Fri Jan 28 01:14:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:16:03.268884 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:16:03.269559 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: Fri Jan 28 01:16:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:16:13.204180 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:16:13.204756 dv-cinder-816898-6-iscsi devstack@n-api.service[116253]: Fri Jan 28 01:16:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:16:18.346992 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:16:18.347581 dv-cinder-816898-6-iscsi devstack@n-api.service[116254]: Fri Jan 28 01:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!